-- Logs begin at Fri 2021-08-27 02:50:26 UTC, end at Fri 2021-08-27 04:24:26 UTC. -- Aug 27 03:22:35.842367 dv-cinder-773985-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 03:22:35.852216 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:22:35 2021] *** Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: nodename: dv-cinder-773985-14-iscsi Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: machine: x86_64 Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: clock source: unix Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: pcre jit disabled Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: detected number of CPU cores: 4 Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: current working directory: / Aug 27 03:22:35.853980 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: your processes number limit is 47680 Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: your memory page size is 4096 bytes Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: detected max file descriptor number: 2048 Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: lock engine: pthread robust mutexes Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: thunder lock: enabled Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 03:22:35.854748 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:22:35.901304 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: Python main interpreter initialized at 0x55d1204a49c0 Aug 27 03:22:35.901304 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: python threads support enabled Aug 27 03:22:35.901304 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: your server socket listen backlog is limited to 100 connections Aug 27 03:22:35.901304 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:22:35.901716 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:22:35.901716 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: *** Operational MODE: preforking *** Aug 27 03:22:35.902002 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:22:35.902002 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: spawned uWSGI master process (pid: 93178) Aug 27 03:22:35.902233 dv-cinder-773985-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 03:22:35.904673 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: spawned uWSGI worker 1 (pid: 93179, cores: 1) Aug 27 03:22:35.904673 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: spawned uWSGI worker 2 (pid: 93180, cores: 1) Aug 27 03:22:35.904673 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:22:37.585625 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:22:37.585625 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: from cryptography.utils import int_from_bytes Aug 27 03:22:37.586856 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:22:37.586856 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: from cryptography.utils import int_from_bytes Aug 27 03:22:37.629565 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:22:37.629565 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: from cryptography.utils import int_from_bytes Aug 27 03:22:37.630257 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:22:37.630257 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: from cryptography.utils import int_from_bytes Aug 27 03:22:40.307189 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:22:40.307858 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:22:40.307967 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:22:40.308257 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:22:40.308511 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:22:40.308898 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.309224 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.309545 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.309862 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.310218 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.310532 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.310852 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.311171 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.311496 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.311756 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.312074 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.312397 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-14-iscsi {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.312720 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.313026 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.313345 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.313659 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.313966 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.314332 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.314688 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.315259 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.316038 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.316354 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.316725 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.317057 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.317374 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.317686 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.318008 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.318341 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.318669 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.318981 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.319650 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-14-iscsi {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.319970 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.320341 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.320711 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.321325 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.321708 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.322038 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.322659 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.322991 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.323305 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.323634 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.323955 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.324277 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.324597 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.324908 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.325217 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.325526 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.325845 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.326175 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.326484 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.326731 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.327037 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.327366 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.327683 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.328006 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.328256 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.328505 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.328823 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.329159 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.329447 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.329536 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:22:40.329997 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.330138 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:22:40.330266 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.330364 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:22:40.330456 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.330591 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:22:40.330683 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.330853 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:22:40.330996 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.331252 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.331355 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.331539 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.331639 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.331857 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.331962 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.332169 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.332264 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.332492 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.332595 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.332795 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.332893 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.333114 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.333212 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.333426 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.333515 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.333742 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.333842 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334002 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334152 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334334 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334447 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334656 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-14-iscsi {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334747 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.334974 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.335075 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.335280 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.335407 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.335588 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.335698 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.335903 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.336170 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.336303 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.336443 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.336634 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.336787 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337026 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337180 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337316 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337424 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337597 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337719 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.337888 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338003 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338278 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338474 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338567 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338790 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.338888 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339094 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339184 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339398 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339496 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339702 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339799 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.339998 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.340128 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.340301 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.340436 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.340604 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.340734 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-14-iscsi {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.340907 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.341043 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.341211 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.341347 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.341514 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.341644 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.341814 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.342063 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.342213 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.342376 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.342505 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.342685 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.342822 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343006 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343218 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343347 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343499 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343626 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343758 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.343892 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344018 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344185 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344313 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344488 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344630 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344808 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.344938 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.345112 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.345240 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.345415 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.345545 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.345722 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.345859 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346035 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346173 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346342 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346471 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346655 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346819 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.346988 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.347144 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.347291 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.347502 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.347703 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.347793 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.347880 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348011 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348117 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348228 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348372 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348506 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348621 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348711 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.348940 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349083 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349260 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349395 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349564 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349674 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349861 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.349967 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.350188 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.350277 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.350487 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.350624 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.350787 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.350887 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.351088 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.351222 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.351385 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.351479 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.352265 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.352372 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.352585 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.352674 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.352929 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.353029 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.353230 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.353320 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.353570 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.353696 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.353883 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.354000 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.354242 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.354340 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.354585 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.354677 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.354894 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.354999 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.355224 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.355314 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.355563 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.355669 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.355877 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.355986 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.356186 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.356276 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.356499 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.356591 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.356822 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.356922 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.357132 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.357221 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.357444 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.357563 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.357748 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.357855 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.358088 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.358181 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.358410 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.358511 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.358713 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.358811 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.359015 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.359104 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.359337 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.359462 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.359649 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.359751 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.359965 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.360053 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.360284 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.360376 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.360590 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.360678 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.360920 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.361022 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.361224 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.361335 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.361540 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.361628 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.361873 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.361974 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.362208 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.362309 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.362533 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.362631 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.362846 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.362957 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.363154 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.363251 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.363469 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.363564 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.363781 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.363887 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.364092 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.364271 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.364407 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.364517 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.364719 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.364810 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.365030 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.365144 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.365370 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.365466 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.365675 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.365783 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.365990 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.366153 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.366323 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.366420 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.366627 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.366734 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.366932 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.367031 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.367300 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.367956 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.368121 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.368225 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.368544 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.368694 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.368853 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.368993 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.369159 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.369249 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.369478 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.369588 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.369781 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.369895 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.370087 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.370192 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.370411 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.370552 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.370715 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.370804 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.371019 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.371109 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.371320 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.371417 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.371623 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.371752 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.371921 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.372021 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.372222 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.372321 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.372526 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.372628 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.372829 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.372937 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.373121 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.373226 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.373430 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.373525 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.373743 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.373833 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.374066 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.374172 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.374378 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.374513 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.374678 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.374779 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.374993 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:22:40.375095 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.375302 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.375392 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.375617 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.375729 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.375955 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376045 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376275 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376393 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376579 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376688 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376901 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.376993 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.377218 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.377322 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.377532 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.377630 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.377832 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.377931 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.378167 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.378274 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.378470 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.378562 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.378773 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.378870 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379075 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379181 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379387 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379480 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379688 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379778 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.379995 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.380126 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.380298 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.380401 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.380602 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.380702 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.380906 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381003 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381217 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381326 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381525 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381629 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381824 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.381915 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.382149 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.382242 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.382454 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.382560 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.382822 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.382967 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.383164 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.383301 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.383475 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.383565 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.383799 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.383912 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.384112 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.384202 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.384432 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.384537 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.384745 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.384851 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385058 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385186 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385364 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385466 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385676 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385779 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.385980 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.386089 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.386312 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.386416 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.386634 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.386725 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.386946 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387092 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387256 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387406 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387560 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387666 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387865 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.387964 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.388165 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.388255 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.388472 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.388563 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.388775 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.388961 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.389089 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.389177 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.389410 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.389529 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.389715 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.389806 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390082 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390175 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390380 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390483 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390691 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390794 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.390997 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.391096 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.391299 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.391410 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.391610 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.391801 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.391915 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392044 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392204 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392292 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392521 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392624 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392829 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.392969 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.393131 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.393241 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.393440 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.393544 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.393748 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.393877 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394068 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394174 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394384 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394524 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394686 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394802 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.394992 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.395111 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.395303 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.395417 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.395622 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.395736 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.395934 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396043 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396237 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396340 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396558 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396693 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396867 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.396957 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.397175 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.397321 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.397483 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.397573 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.397788 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.397887 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.398118 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.398252 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.398446 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.398550 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.398761 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.398958 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.399075 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.399271 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.399363 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.399581 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.399672 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.399888 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400013 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400199 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400292 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400507 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400710 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400815 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.400903 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.401103 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.401210 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.401409 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.401542 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.401712 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.401816 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402047 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402143 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402358 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402467 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402662 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402755 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.402962 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403060 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403266 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403363 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403573 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403685 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403879 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.403999 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.404183 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.404278 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.404486 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.404586 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.404827 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.404962 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.405138 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.405246 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.405449 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.405576 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.405763 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.405881 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.406094 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.406212 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.406408 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.406553 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.406714 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.406818 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407022 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407137 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407332 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407467 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407637 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407736 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.407945 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408035 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408252 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408358 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408557 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408648 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408862 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.408951 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.409167 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.409275 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.409473 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.409562 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.409787 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.409885 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.410118 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.410215 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.410425 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.410526 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.410734 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.410845 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411037 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411137 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411346 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411445 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411663 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411785 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.411972 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.412234 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.412336 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.412567 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.412666 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.412878 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.412983 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.413187 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.413296 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.413493 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.413595 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.413809 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.413913 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.414696 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.414825 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.415017 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.415202 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.415319 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.415580 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.415718 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.415908 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416020 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416211 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416395 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416506 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416602 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416811 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.416938 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.417111 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.417217 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.417414 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.417520 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.417720 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.417815 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418076 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418191 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418356 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418452 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418659 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418783 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.418971 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419083 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419273 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419373 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419583 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419699 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419880 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.419991 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.420192 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.420292 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.420494 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.420632 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.420800 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.420910 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421108 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421223 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421398 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421520 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421692 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421827 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.421998 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.422155 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.422320 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.422446 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.422628 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.422765 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.422950 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.423086 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.423258 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.423389 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.423576 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.423706 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.423899 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424037 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424203 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424349 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424499 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424619 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424821 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.424956 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425208 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425399 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425399 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425643 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425730 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425863 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.425983 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.426099 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.426329 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.426440 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.426642 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.426740 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.426940 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427037 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427246 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427345 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427557 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427690 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427858 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.427971 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.428165 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.428255 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.428466 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.428566 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.428772 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.428868 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.429076 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.429173 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.429383 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.429489 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.429705 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.430383 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.430560 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.430707 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.430867 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.430966 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.431170 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.431271 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.431481 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.431617 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.431780 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.431875 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.432095 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.432202 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.432400 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.432490 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.432701 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.432789 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433003 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433103 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433312 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433449 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433617 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433722 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.433918 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.434212 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.434316 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.434549 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.434685 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.434850 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.434965 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.435155 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.435295 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.435462 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.435578 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.435767 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.435900 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436069 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436190 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436393 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436488 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436696 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436799 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.436996 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.437116 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.437301 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.437403 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.437600 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.437745 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.437900 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438052 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438225 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438324 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438534 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438670 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438830 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.438930 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.439131 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.439241 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.439432 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.439525 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.439734 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.439859 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440036 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440135 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440343 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440434 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440646 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440758 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.440931 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441016 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441233 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441376 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441532 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441625 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441837 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.441925 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.442189 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.442302 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.442501 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.442620 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.442806 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.442908 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.443110 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.443245 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.443412 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.443522 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.443742 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.443878 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.444519 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.444663 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.444663 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.444897 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.445003 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.445090 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.445243 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.445722 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.446046 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.446159 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.446263 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.446263 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.446485 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.446768 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.447084 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.447392 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.447708 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.447895 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.448025 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.448255 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.448401 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.448586 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.448724 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.448912 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.449058 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.449221 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.449379 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.449526 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.449903 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.450178 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.450489 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.450803 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.451114 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.451422 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.451553 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.451732 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.451865 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.452036 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.452346 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.452655 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.452958 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.453272 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.453390 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.453586 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.453679 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.453891 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454099 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454222 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454350 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454520 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454623 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454830 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.454947 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.455140 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.455237 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.455536 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.455667 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.455865 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.455970 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.456178 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.456289 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.456483 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.456582 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.456793 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.456917 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.457104 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.457204 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.457419 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.457523 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.457735 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.457868 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.458050 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.458184 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.458369 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.458486 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.458697 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.458804 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.459007 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.459093 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.459318 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.459408 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.459626 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.459727 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460176 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460319 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460407 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460487 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460565 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460824 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.460960 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.461234 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.461385 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.461477 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.461574 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.461792 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.461925 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.462121 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.462224 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.462434 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.462564 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.462746 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.462877 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.463066 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.463202 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.463397 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.463549 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.463719 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464033 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464131 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464351 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464498 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464660 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464814 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.464969 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465094 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465279 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465380 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465590 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465693 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465899 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.465989 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.466235 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.466360 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.466539 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.466654 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.466851 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.466944 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.467161 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.467265 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.467489 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.467620 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.467799 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.467901 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.468107 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.468229 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.468416 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.468533 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.468720 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.468823 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.469040 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.469169 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.469360 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.469462 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.469730 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.469862 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.470061 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.470165 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.470385 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.470504 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.470712 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.470853 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471025 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471146 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471331 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471432 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471638 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471752 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.471949 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.472070 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.472249 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.472393 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.472556 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.472794 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.472923 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473039 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473152 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473244 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473455 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473554 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473767 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.473851 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.474095 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.474183 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.474402 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.474502 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.474708 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.474796 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475035 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475119 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475338 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475424 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475655 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475746 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.475968 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.476053 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.476281 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.476389 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.477175 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.477360 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.477666 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.477752 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.478099 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.478195 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.478457 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.478543 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.478767 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.478866 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.479082 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.479180 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.479384 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.479470 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.479729 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.479827 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480036 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480121 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480350 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480453 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480662 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480766 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.480971 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481059 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481288 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481372 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481599 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481695 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481908 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.481994 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.482245 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.482331 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.482555 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.482643 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.482869 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.482954 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.483180 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.483264 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.483485 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.483617 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.483795 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.483933 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.484099 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.484246 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.484404 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.484553 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.484707 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.484865 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485015 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485178 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485318 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485497 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485625 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485816 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.485913 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.486149 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.486253 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.486560 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.486661 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.486873 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.486964 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.487179 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.487264 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.487484 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.487578 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.487789 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.487880 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.488090 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.488173 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.488399 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.488485 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.488727 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.488801 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489032 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489122 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489339 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489426 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489654 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489784 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.489971 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.490075 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.490301 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.490403 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.490623 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.490708 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.490941 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.491027 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.491256 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.491350 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.491572 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.491666 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.491886 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.492043 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.492275 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.492898 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.493214 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.493300 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.493577 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.493713 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.493897 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.494137 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.494234 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.494470 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.494564 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.494782 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.494869 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.495102 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.495415 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.495520 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.495742 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.495892 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496058 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496135 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496371 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496467 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496686 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496792 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.496992 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.497087 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.497311 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.497406 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.497626 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.497716 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.497941 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.498041 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.498294 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.498447 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.498634 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.498999 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.499096 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.499361 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.499453 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.499734 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.499832 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.500129 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.500237 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.500481 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.500703 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.500835 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.501106 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.501193 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.501505 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.501691 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.501916 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.502051 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.502307 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.502401 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.502661 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.502747 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.503023 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.503149 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.503391 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.503598 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.503764 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.504012 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.504108 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.504461 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.504547 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.504822 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.504907 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.505180 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.505275 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.505503 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.505596 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.505818 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.505905 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.506201 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.506305 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.506522 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.506646 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.506892 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.507017 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.507235 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.507410 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.507600 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.507847 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.507995 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.508282 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.508380 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.508613 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.508768 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.509081 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.509177 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.509392 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.509489 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.509703 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.509789 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.510048 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.510138 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.510386 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.510485 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.510723 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.510807 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.511089 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.511174 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.511426 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.511540 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.511780 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.511867 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.512091 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.512179 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.512407 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.512539 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.512720 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.512816 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.513026 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.513172 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.513351 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.513559 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.513708 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.513960 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.514096 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.514314 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.514465 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.514754 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.514850 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.515191 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.515371 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.515502 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.515724 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.515812 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.516044 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.516230 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.516396 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.516655 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.516765 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.516981 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.517079 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.517287 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.517438 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.517654 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.517755 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.518065 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.518178 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.518380 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.518473 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.518713 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.518827 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519026 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519151 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519337 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519428 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519657 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519746 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.519968 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520053 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520280 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520365 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520588 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520676 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520901 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.520994 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.521208 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.521304 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.521538 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.521638 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.521847 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.521934 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.522191 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.522295 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.522542 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.522636 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.522814 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.522900 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.523130 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.523772 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.523772 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.523943 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.524102 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.524270 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.524421 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.524586 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.524739 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.524891 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.525051 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.525220 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.525367 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.525533 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.525684 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.525851 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.526005 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.526186 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.526530 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.526622 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.526814 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.526900 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.527129 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.527257 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.527437 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.527635 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.527764 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.528029 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.528121 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.528373 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.528468 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.528689 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.528792 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.529095 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.529197 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.529453 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.529596 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.529769 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.529858 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.530112 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.530317 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.530463 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.530673 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.530824 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.531028 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.531442 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.531555 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.531810 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.531897 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.532166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.532262 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.532514 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.532607 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.532856 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.532945 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.533166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.533259 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.533474 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.533574 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.533782 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.533868 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.534132 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.534269 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.534448 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.534594 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.534761 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.534913 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.535072 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.535231 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.535387 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.535548 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.535696 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.535862 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536004 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536175 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536314 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536491 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536623 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536802 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.536931 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.537112 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.537241 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.537425 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.537549 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.537740 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.537917 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.538089 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.538263 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.538427 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.538584 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.538749 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.538901 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.539635 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.539775 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.540038 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.540130 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.540360 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.540445 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.540676 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.540989 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.541075 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.541307 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.541428 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.541640 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.541736 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.541958 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.542060 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.542293 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.542380 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.542627 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.542743 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.542948 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.543035 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.543341 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.543543 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.543665 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.543946 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.544047 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.544234 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.544390 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.544680 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.544782 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.545630 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.545736 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.545827 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.545909 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.545989 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546162 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546250 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546336 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546336 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546481 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546660 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546757 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.546973 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.547060 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.551518 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.551676 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.551813 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.551929 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552039 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552153 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552258 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552364 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552478 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552585 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552706 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552818 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.552923 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553027 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553139 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553139 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553339 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553443 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553553 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553663 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553776 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553881 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.553990 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.554126 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.554232 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.554232 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.554442 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.554557 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.554697 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.555404 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.555577 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.555758 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.555920 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.556029 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.556269 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.556392 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.556506 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.556622 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557288 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557385 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557474 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557561 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557650 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557731 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557816 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557896 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.557975 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558082 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558166 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558431 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558521 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558601 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558686 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558765 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558844 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.558921 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559008 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559095 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559175 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559254 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559332 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559410 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559496 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559575 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559653 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559734 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559813 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559899 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.559969 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560042 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560109 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560174 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560239 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560324 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560405 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560483 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560561 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560639 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560795 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.560891 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.561110 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.561194 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.561361 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:22:40.561446 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.561740 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.562074 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.562428 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.562751 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.563316 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.563655 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.564002 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.564349 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.564693 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.565004 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.565366 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.565623 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.565945 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.566286 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.566597 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.566908 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.567223 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.567534 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.567845 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.568162 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.568782 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.568782 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.569126 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.569652 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.570143 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.570393 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.570716 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.571249 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.571343 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.571661 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.572211 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.572580 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.572964 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.573542 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.574083 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.576871 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.577384 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.577384 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.577730 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.578189 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.578615 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.579104 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.579604 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.580139 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.580606 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.580912 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.581228 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.581674 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.581996 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.582393 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.582815 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.583215 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.583566 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.583895 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.584212 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.584542 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.584874 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.585236 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.585518 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_db.sqlalchemy.engines [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:40.585625 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.585959 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.586954 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.586954 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.587139 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.587358 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.587669 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.587981 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.588385 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.588830 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.589096 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.589559 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.589922 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.590262 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.590602 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.590940 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.591334 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.591794 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.592146 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.592434 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.592823 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.593172 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.593492 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.593819 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.594169 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.594513 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.594838 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.596332 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.596332 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.596332 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.596332 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:22:40.596698 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:22:40.621637 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_db.sqlalchemy.engines [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:40.669915 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.context [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744d09d0-5228-4066-927d-4e439a7622b0(cell1) {{(pid=93180) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:22:40.670907 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_concurrency.lockutils [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:40.672492 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_concurrency.lockutils [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:40.673332 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_concurrency.lockutils [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:40.675300 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_concurrency.lockutils [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:40.688216 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_db.sqlalchemy.engines [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:40.690590 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_db.sqlalchemy.engines [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:40.702773 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.context [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744d09d0-5228-4066-927d-4e439a7622b0(cell1) {{(pid=93179) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:22:40.707231 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:40.708872 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:40.709729 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:40.712463 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:40.727394 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_db.sqlalchemy.engines [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:40.730074 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_db.sqlalchemy.engines [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:41.050211 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG oslo_db.sqlalchemy.engines [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:41.097717 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_db.sqlalchemy.engines [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:22:41.400434 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: WARNING keystonemiddleware.auth_token [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:22:41.406884 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: WARNING keystonemiddleware.auth_token [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:22:41.425373 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: WARNING keystonemiddleware.auth_token [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:22:41.432773 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: WARNING keystonemiddleware.auth_token [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:22:41.760492 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: WARNING keystonemiddleware.auth_token [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:22:41.765625 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: WARNING keystonemiddleware.auth_token [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:22:41.770991 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1204a49c0 pid: 93180 (default app) Aug 27 03:22:41.773053 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:41.774807 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002306 Aug 27 03:22:41.775477 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 789 bytes} [Fri Aug 27 03:22:41 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:41.785724 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: WARNING keystonemiddleware.auth_token [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:22:41.791953 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: WARNING keystonemiddleware.auth_token [None req-41aac071-dba0-4241-86a9-9e439115e5ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:22:41.797337 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1204a49c0 pid: 93179 (default app) Aug 27 03:24:03.739903 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:03.740902 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 27 03:24:03.741302 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:04.185677 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-7ac8ae69-c896-408a-b12c-d3dc63e88d82 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:04.215797 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-7ac8ae69-c896-408a-b12c-d3dc63e88d82 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465999 Aug 27 03:24:04.216751 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Aug 27 03:24:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:06.466867 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:06.467870 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-63c16b06-1b8e-4e6a-ae12-dec2c8c746db None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 27 03:24:06.468487 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:06.537868 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-465eb37a-1564-47e4-a7ea-4486a2391945 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:06.557253 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:24:06.557253 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: warnings.warn(msg) Aug 27 03:24:06.591787 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-465eb37a-1564-47e4-a7ea-4486a2391945 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115804 Aug 27 03:24:06.592490 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:06 2021] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:06.818659 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-6acbc7b9-4c05-48e8-9a59-71393f432088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:06.822411 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:24:06.822411 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: warnings.warn(msg) Aug 27 03:24:06.876084 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-6acbc7b9-4c05-48e8-9a59-71393f432088 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274222 Aug 27 03:24:06.881075 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Aug 27 03:24:06 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:09.110305 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-465eb37a-1564-47e4-a7ea-4486a2391945 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:09.111252 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-465eb37a-1564-47e4-a7ea-4486a2391945 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 27 03:24:09.111651 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:09.227598 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-307b83b4-8875-40a7-830f-91bbc25b5814 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:09.245565 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:24:09.245565 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: warnings.warn(msg) Aug 27 03:24:09.263594 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-307b83b4-8875-40a7-830f-91bbc25b5814 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144832 Aug 27 03:24:09.264149 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:09.276839 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-edb74640-6d4d-4117-8c6d-cd090910b1ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:09.278789 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:24:09.278789 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: warnings.warn(msg) Aug 27 03:24:09.312802 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-edb74640-6d4d-4117-8c6d-cd090910b1ac admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039801 Aug 27 03:24:09.313317 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Aug 27 03:24:09 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:11.678064 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-307b83b4-8875-40a7-830f-91bbc25b5814 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:11.679163 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-307b83b4-8875-40a7-830f-91bbc25b5814 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 27 03:24:11.679581 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:11.741406 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-342c6dc3-7b9c-489c-a5a7-d461fd593c00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "id": "d2", "swap": 0, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:11.762823 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-342c6dc3-7b9c-489c-a5a7-d461fd593c00 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075016 Aug 27 03:24:11.763480 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:11.776628 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-4de96db5-4759-44a3-a9a3-884cb0def9f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:11.807099 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-4de96db5-4759-44a3-a9a3-884cb0def9f3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034812 Aug 27 03:24:11.807589 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Aug 27 03:24:11 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:14.048996 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-342c6dc3-7b9c-489c-a5a7-d461fd593c00 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:14.050195 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-342c6dc3-7b9c-489c-a5a7-d461fd593c00 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 27 03:24:14.050594 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:14.112123 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-d9e05dea-f3df-40c1-8374-e28623f40fcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:14.130738 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-d9e05dea-f3df-40c1-8374-e28623f40fcc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072934 Aug 27 03:24:14.131420 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:14.145056 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-7801cdb9-bb95-48a9-8cef-21b1977730bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:14.169430 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-7801cdb9-bb95-48a9-8cef-21b1977730bf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028404 Aug 27 03:24:14.170063 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Aug 27 03:24:14 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:16.411231 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-d9e05dea-f3df-40c1-8374-e28623f40fcc admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:16.412252 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-d9e05dea-f3df-40c1-8374-e28623f40fcc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 27 03:24:16.412650 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:16.480103 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-2301cfc1-2463-4fc7-98ed-d511fa5befc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G"}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:16.501606 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-2301cfc1-2463-4fc7-98ed-d511fa5befc9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081491 Aug 27 03:24:16.502186 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:16.520317 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-5cab972f-3a7b-442b-99ef-156b8fc88e86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:16.553181 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-5cab972f-3a7b-442b-99ef-156b8fc88e86 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038014 Aug 27 03:24:16.559252 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Aug 27 03:24:16 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:18.799563 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-2301cfc1-2463-4fc7-98ed-d511fa5befc9 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:18.800562 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-2301cfc1-2463-4fc7-98ed-d511fa5befc9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 27 03:24:18.800954 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:18.869352 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-9cb5da57-44ab-4455-bdb5-6fff4cf97ac7 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:18.892456 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-9cb5da57-44ab-4455-bdb5-6fff4cf97ac7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084522 Aug 27 03:24:18.892979 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Aug 27 03:24:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:21.171114 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-2301cfc1-2463-4fc7-98ed-d511fa5befc9 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.172687 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-2301cfc1-2463-4fc7-98ed-d511fa5befc9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Aug 27 03:24:21.173355 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:21.238878 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-be5cc002-aef1-4a4a-aaf7-5969ca67d3a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:21.259123 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-be5cc002-aef1-4a4a-aaf7-5969ca67d3a3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076852 Aug 27 03:24:21.259690 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:21 2021] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:21.274904 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-a13b1dbe-bdac-44a2-855c-8618ea5eadb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:21.297548 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-a13b1dbe-bdac-44a2-855c-8618ea5eadb8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026805 Aug 27 03:24:21.298169 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Aug 27 03:24:21 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:23.585809 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-be5cc002-aef1-4a4a-aaf7-5969ca67d3a3 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:23.587267 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-be5cc002-aef1-4a4a-aaf7-5969ca67d3a3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 27 03:24:23.587483 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:23.659432 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-44516e9b-3139-4308-9e07-e12a1157a6b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:23.679852 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-44516e9b-3139-4308-9e07-e12a1157a6b9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085371 Aug 27 03:24:23.680539 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:24:23.693995 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-a7b92e00-5b2a-4e49-8fab-cd6dd0cf89a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:23.722958 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-a7b92e00-5b2a-4e49-8fab-cd6dd0cf89a5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032482 Aug 27 03:24:23.723971 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Aug 27 03:24:23 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:25.975094 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-44516e9b-3139-4308-9e07-e12a1157a6b9 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:25.976097 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-44516e9b-3139-4308-9e07-e12a1157a6b9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 27 03:24:25.976501 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:26.036153 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-c2a74500-a744-4d73-aef4-9684384ac5d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:26.054359 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-c2a74500-a744-4d73-aef4-9684384ac5d3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071356 Aug 27 03:24:26.055453 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:25 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:26.067902 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-589b0c7e-1296-495a-b3f8-efc3ebae57e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:26.092070 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-589b0c7e-1296-495a-b3f8-efc3ebae57e5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027761 Aug 27 03:24:26.092649 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Aug 27 03:24:26 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:28.334231 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-c2a74500-a744-4d73-aef4-9684384ac5d3 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:28.335385 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-c2a74500-a744-4d73-aef4-9684384ac5d3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 27 03:24:28.335857 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:28.406394 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-bfd1c20b-2dc4-4274-9308-cf04391e7751 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "vcpus": 4, "ram": 8192}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:28.427656 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-bfd1c20b-2dc4-4274-9308-cf04391e7751 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083910 Aug 27 03:24:28.428210 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:24:28.447406 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-90f61a47-67d1-43ca-80ee-3836e9c0a2ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:28.472221 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-90f61a47-67d1-43ca-80ee-3836e9c0a2ea admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029505 Aug 27 03:24:28.472794 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Aug 27 03:24:28 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:30.744039 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-bfd1c20b-2dc4-4274-9308-cf04391e7751 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:30.745084 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-bfd1c20b-2dc4-4274-9308-cf04391e7751 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 27 03:24:30.745614 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:24:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:30.810468 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-8ca7143a-d285-428b-99f6-ec8034bf47cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "swap": 0, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:30.830551 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-8ca7143a-d285-428b-99f6-ec8034bf47cf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078431 Aug 27 03:24:30.831709 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Aug 27 03:24:30 2021] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:24:30.843412 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-2daf7480-0ade-4b41-9bfe-48c42ac87624 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:30.866680 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-2daf7480-0ade-4b41-9bfe-48c42ac87624 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026823 Aug 27 03:24:30.868188 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Aug 27 03:24:30 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:11.084901 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-8ca7143a-d285-428b-99f6-ec8034bf47cf admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:11.085963 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-8ca7143a-d285-428b-99f6-ec8034bf47cf admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 27 03:25:11.086434 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:25:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:11.151937 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-016116b8-1146-42d2-985c-139b3b06e796 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:11.170710 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-016116b8-1146-42d2-985c-139b3b06e796 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076781 Aug 27 03:25:11.171270 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Aug 27 03:25:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:12.761060 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-8ca7143a-d285-428b-99f6-ec8034bf47cf admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:12.762085 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-8ca7143a-d285-428b-99f6-ec8034bf47cf admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 27 03:25:12.762483 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:12.956865 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-b9fad50a-5dc9-4b09-a200-05d5a83f12cf admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:12.962605 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.wsgi [None req-b9fad50a-5dc9-4b09-a200-05d5a83f12cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 03:25:12.963163 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-b9fad50a-5dc9-4b09-a200-05d5a83f12cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:25:12.963954 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-b9fad50a-5dc9-4b09-a200-05d5a83f12cf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.061748 Aug 27 03:25:12.964455 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Aug 27 03:25:12 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:12.974853 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-7d7d1dfc-be86-4a7c-a5f8-482f0fbec281 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:12.999103 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-7d7d1dfc-be86-4a7c-a5f8-482f0fbec281 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.028263 Aug 27 03:25:12.999692 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Aug 27 03:25:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:13.010193 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-3b85fe34-f2a7-4227-89f5-0c204f9964c3 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:13.032507 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-3b85fe34-f2a7-4227-89f5-0c204f9964c3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026025 Aug 27 03:25:13.033055 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Aug 27 03:25:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:13.043567 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-9bae45f8-7dc5-4a8f-a51b-266f20b5fda0 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:13.048967 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.wsgi [None req-9bae45f8-7dc5-4a8f-a51b-266f20b5fda0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 03:25:13.049517 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-9bae45f8-7dc5-4a8f-a51b-266f20b5fda0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:25:13.050317 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-9bae45f8-7dc5-4a8f-a51b-266f20b5fda0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010322 Aug 27 03:25:13.050808 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Aug 27 03:25:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 03:25:14.432057 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-3b85fe34-f2a7-4227-89f5-0c204f9964c3 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.433087 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-3b85fe34-f2a7-4227-89f5-0c204f9964c3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 27 03:25:14.433497 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:14.624259 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-9ccc0405-46a1-4f10-be99-7eaeae82987c admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.631338 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.wsgi [None req-9ccc0405-46a1-4f10-be99-7eaeae82987c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 03:25:14.631892 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-9ccc0405-46a1-4f10-be99-7eaeae82987c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:25:14.633219 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-9ccc0405-46a1-4f10-be99-7eaeae82987c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.060547 Aug 27 03:25:14.633789 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Aug 27 03:25:14 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 03:25:14.643614 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-f1e95d4f-ca62-4bd0-ad72-ec5c71f14b99 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.657573 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-f1e95d4f-ca62-4bd0-ad72-ec5c71f14b99 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017527 Aug 27 03:25:14.658110 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Aug 27 03:25:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:14.668613 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-98e839ab-ad52-47ea-a65d-f101c1104d7f admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.682663 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-98e839ab-ad52-47ea-a65d-f101c1104d7f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017538 Aug 27 03:25:14.683188 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Aug 27 03:25:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:14.692861 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-19996930-7dac-48ab-b56d-aedb28de59fa admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.699085 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.wsgi [None req-19996930-7dac-48ab-b56d-aedb28de59fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 03:25:14.699644 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-19996930-7dac-48ab-b56d-aedb28de59fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:25:14.700436 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-19996930-7dac-48ab-b56d-aedb28de59fa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.011085 Aug 27 03:25:14.700925 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Aug 27 03:25:14 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:16.060014 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-98e839ab-ad52-47ea-a65d-f101c1104d7f admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.061077 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-98e839ab-ad52-47ea-a65d-f101c1104d7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 27 03:25:16.061472 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:16.261296 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-8b793fa4-5357-45a4-85ab-bc3f8489c21f admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.267077 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.wsgi [None req-8b793fa4-5357-45a4-85ab-bc3f8489c21f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 03:25:16.267577 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-8b793fa4-5357-45a4-85ab-bc3f8489c21f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:25:16.268361 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-8b793fa4-5357-45a4-85ab-bc3f8489c21f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.060792 Aug 27 03:25:16.268858 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Aug 27 03:25:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:16.278755 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-22374317-83a5-49e6-b5f2-d1a701991b47 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.292579 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-22374317-83a5-49e6-b5f2-d1a701991b47 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017342 Aug 27 03:25:16.293096 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Aug 27 03:25:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:16.303261 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.317858 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018208 Aug 27 03:25:16.318467 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Aug 27 03:25:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:16.329644 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-14ea15bf-47ff-432d-b1b4-323d5cae58bc admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.334918 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.wsgi [None req-14ea15bf-47ff-432d-b1b4-323d5cae58bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 03:25:16.336185 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-14ea15bf-47ff-432d-b1b4-323d5cae58bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:25:16.337057 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-14ea15bf-47ff-432d-b1b4-323d5cae58bc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.011226 Aug 27 03:25:16.337549 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Aug 27 03:25:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:17.737590 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:17.738617 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 27 03:25:17.739039 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:17.931861 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-a31fe100-7a27-40b6-844e-9ed2ea49285d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:17.950448 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-a31fe100-7a27-40b6-844e-9ed2ea49285d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.071929 Aug 27 03:25:17.950984 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1236 bytes} [Fri Aug 27 03:25:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:25:19.304884 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:19.305885 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 27 03:25:19.306310 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:19.501318 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-e18bc77f-f73c-4a47-8955-f3211ce2f0cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:19.519167 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-e18bc77f-f73c-4a47-8955-f3211ce2f0cd admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.071329 Aug 27 03:25:19.519604 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1236 bytes} [Fri Aug 27 03:25:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:25:20.882925 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:20.884201 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002402 Aug 27 03:25:20.884699 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:21.076602 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-3684023b-6d13-4d33-b6b9-cfa906929e7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:21.094862 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-3684023b-6d13-4d33-b6b9-cfa906929e7f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.069998 Aug 27 03:25:21.095335 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1236 bytes} [Fri Aug 27 03:25:21 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:25:22.496983 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.497983 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 27 03:25:22.498395 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:22.689191 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-9cdd13ea-8571-4e3e-b41d-dc611751cdf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:22.707580 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-9cdd13ea-8571-4e3e-b41d-dc611751cdf3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.069876 Aug 27 03:25:22.708139 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1236 bytes} [Fri Aug 27 03:25:22 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:25:24.069419 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:24.070960 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Aug 27 03:25:24.071353 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:25:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:24.260961 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-3b6d1e5f-fdab-4b21-b7d9-e7354ca5318c admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:24.279905 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-3b6d1e5f-fdab-4b21-b7d9-e7354ca5318c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.069909 Aug 27 03:25:24.280366 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1203 bytes} [Fri Aug 27 03:25:24 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:09.580691 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.581693 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-0642493b-edba-463b-a43e-fa7ef130a74c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 27 03:26:09.582106 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Fri Aug 27 03:26:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:09.641452 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-f5779a06-62f7-41ce-8a8e-dbdc39277eec admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.661068 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-f5779a06-62f7-41ce-8a8e-dbdc39277eec admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071960 Aug 27 03:26:09.661637 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Aug 27 03:26:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:26:09.683434 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-774ec7ff-5062-4226-8820-3b605fdc5398 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.690935 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-774ec7ff-5062-4226-8820-3b605fdc5398 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011088 Aug 27 03:26:09.691420 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Fri Aug 27 03:26:09 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:09.704290 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-de9c6bed-7606-4bdf-aaa9-4d40ad61c321 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.712641 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-de9c6bed-7606-4bdf-aaa9-4d40ad61c321 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011923 Aug 27 03:26:09.713161 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Fri Aug 27 03:26:09 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:09.725254 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-ffd7ceb3-6a99-4521-aaf1-91f229836b06 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.732903 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-ffd7ceb3-6a99-4521-aaf1-91f229836b06 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011478 Aug 27 03:26:09.733416 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Fri Aug 27 03:26:09 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:09.745202 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.752664 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011031 Aug 27 03:26:09.753161 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Fri Aug 27 03:26:09 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:29.934739 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-09ad2628-8f47-48a1-8ac7-fd55333db0b5 tempest-verify_tempest_config-942673932 tempest-verify_tempest_config-942673932-project] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:29.936690 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-09ad2628-8f47-48a1-8ac7-fd55333db0b5 tempest-verify_tempest_config-942673932 tempest-verify_tempest_config-942673932-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111074 Aug 27 03:27:29.937218 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Aug 27 03:27:29 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:29:03.505853 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.506980 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 27 03:29:03.507379 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:29:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:03.784770 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-25be0e4f-66e1-493e-926b-5c62040750cf admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.785920 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:03.785920 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: warnings.warn(msg) Aug 27 03:29:03.787493 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-25be0e4f-66e1-493e-926b-5c62040750cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:03.787935 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-25be0e4f-66e1-493e-926b-5c62040750cf admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:03.788731 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-25be0e4f-66e1-493e-926b-5c62040750cf admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:03.789159 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-25be0e4f-66e1-493e-926b-5c62040750cf admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:03.825225 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-25be0e4f-66e1-493e-926b-5c62040750cf admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.170623 Aug 27 03:29:03.825788 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 35/71] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Aug 27 03:29:03 2021] GET /compute/v2.1/os-services => generated 794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:29:05.205174 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.206244 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 27 03:29:05.206665 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:29:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:05.401591 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-68af76d5-ff2d-4c35-b37a-0835c8d8b2d4 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.402768 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:05.402768 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: warnings.warn(msg) Aug 27 03:29:05.404289 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-68af76d5-ff2d-4c35-b37a-0835c8d8b2d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:05.404721 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-68af76d5-ff2d-4c35-b37a-0835c8d8b2d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:05.405521 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-68af76d5-ff2d-4c35-b37a-0835c8d8b2d4 admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:05.406592 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-68af76d5-ff2d-4c35-b37a-0835c8d8b2d4 admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:05.425303 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-68af76d5-ff2d-4c35-b37a-0835c8d8b2d4 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.077081 Aug 27 03:29:05.425857 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 36/73] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Aug 27 03:29:05 2021] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:29:17.238179 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.239249 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 27 03:29:17.239740 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:29:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:17.435490 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-a8c5b366-cf33-4cd0-8bbc-09338aa84e06 admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.436731 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:17.436731 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: warnings.warn(msg) Aug 27 03:29:17.438226 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-a8c5b366-cf33-4cd0-8bbc-09338aa84e06 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:17.438667 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-a8c5b366-cf33-4cd0-8bbc-09338aa84e06 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:17.439757 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-a8c5b366-cf33-4cd0-8bbc-09338aa84e06 admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:17.440179 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-a8c5b366-cf33-4cd0-8bbc-09338aa84e06 admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:17.464565 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-a8c5b366-cf33-4cd0-8bbc-09338aa84e06 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.88 time: 0.080053 Aug 27 03:29:17.465041 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 37/75] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Aug 27 03:29:17 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:18.867556 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: DEBUG nova.api.openstack.wsgi [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] Calling method '>' {{(pid=93180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.868555 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: INFO nova.api.openstack.requestlog [None req-62f94dfb-d3a4-48d1-a3fb-5340ca7c17b5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 27 03:29:18.868947 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: [pid: 93180|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1075 bytes} [Fri Aug 27 03:29:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:19.066214 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG nova.api.openstack.wsgi [None req-588bed2d-5f19-4003-930d-04fd51c1ba3a admin admin] Calling method '>' {{(pid=93179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.067414 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:19.067414 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: warnings.warn(msg) Aug 27 03:29:19.068906 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-588bed2d-5f19-4003-930d-04fd51c1ba3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:19.069393 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-588bed2d-5f19-4003-930d-04fd51c1ba3a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:19.070190 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-588bed2d-5f19-4003-930d-04fd51c1ba3a admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:19.070615 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: DEBUG oslo_concurrency.lockutils [None req-588bed2d-5f19-4003-930d-04fd51c1ba3a admin admin] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:19.091500 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: INFO nova.api.openstack.requestlog [None req-588bed2d-5f19-4003-930d-04fd51c1ba3a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.88 time: 0.079436 Aug 27 03:29:19.091979 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: [pid: 93179|app: 0|req: 38/77] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Aug 27 03:29:19 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:18.277091 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: Fri Aug 27 03:30:18 2021 - graceful shutdown triggered... Aug 27 03:30:18.276580 dv-cinder-773985-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 03:30:18.278075 dv-cinder-773985-14-iscsi devstack@n-api.service[93180]: Gracefully killing worker 2 (pid: 93180)... Aug 27 03:30:18.278476 dv-cinder-773985-14-iscsi devstack@n-api.service[93179]: Gracefully killing worker 1 (pid: 93179)... Aug 27 03:30:19.277583 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: worker 1 buried after 1 seconds Aug 27 03:30:19.278134 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: worker 2 buried after 1 seconds Aug 27 03:30:19.278134 dv-cinder-773985-14-iscsi devstack@n-api.service[93178]: goodbye to uWSGI. Aug 27 03:30:19.279200 dv-cinder-773985-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 27 03:30:19.279752 dv-cinder-773985-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 03:30:19.282568 dv-cinder-773985-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 03:30:19.292609 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:30:19 2021] *** Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: nodename: dv-cinder-773985-14-iscsi Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: machine: x86_64 Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: clock source: unix Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: pcre jit disabled Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: detected number of CPU cores: 4 Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: current working directory: / Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:30:19.294644 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: your processes number limit is 47680 Aug 27 03:30:19.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: your memory page size is 4096 bytes Aug 27 03:30:19.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: detected max file descriptor number: 2048 Aug 27 03:30:19.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: lock engine: pthread robust mutexes Aug 27 03:30:19.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: thunder lock: enabled Aug 27 03:30:19.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 03:30:19.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:30:19.341388 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: Python main interpreter initialized at 0x55e0ce98d9c0 Aug 27 03:30:19.341388 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: python threads support enabled Aug 27 03:30:19.341388 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: your server socket listen backlog is limited to 100 connections Aug 27 03:30:19.341388 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:30:19.341883 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:30:19.341883 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: *** Operational MODE: preforking *** Aug 27 03:30:19.342160 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:30:19.342160 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: spawned uWSGI master process (pid: 109019) Aug 27 03:30:19.342373 dv-cinder-773985-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 03:30:19.342931 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: spawned uWSGI worker 1 (pid: 109036, cores: 1) Aug 27 03:30:19.347058 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: spawned uWSGI worker 2 (pid: 109037, cores: 1) Aug 27 03:30:19.347058 dv-cinder-773985-14-iscsi devstack@n-api.service[109019]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:30:21.218387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:30:21.218387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: from cryptography.utils import int_from_bytes Aug 27 03:30:21.219073 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:30:21.219073 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: from cryptography.utils import int_from_bytes Aug 27 03:30:21.264966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:30:21.264966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: from cryptography.utils import int_from_bytes Aug 27 03:30:21.265603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:30:21.265603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: from cryptography.utils import int_from_bytes Aug 27 03:30:23.776633 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:30:23.777152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:30:23.777380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:30:23.777742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:30:23.777997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:30:23.778421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.778753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.779077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.779399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.779735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.780069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.780370 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.780690 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.781014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.781273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.781591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.781913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-14-iscsi {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.782273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.782581 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.782891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.783798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.784107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.784428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.784735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.785236 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.787048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.787048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.787048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.787048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.787048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.788777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.788777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.788777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.788777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.788777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.790499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-14-iscsi {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.790499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.790499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.790499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.790499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.792495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.793010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.793088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.793355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.793830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.794172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.794671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.794982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.795290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.795541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.795850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.796173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.796489 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.796983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.797388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.797652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.797969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.798333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.798774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.799089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.799398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.799705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.800011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.800336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.800622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.800926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.801243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.801559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.801879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.802211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.802703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.803325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.803573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.803879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.804225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.804548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.804857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.805247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.805559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.805870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.806251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.806515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.806836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.807161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.807468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.807727 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.808030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.808336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.808659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.808965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.809271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.809575 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.809872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.810206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.810514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.810821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.811128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.811433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.811737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.812042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.812372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.812715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.812969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.813279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.813842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.814202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.814509 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.814947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.815277 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.815586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.815896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.816283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.816508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.816813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.817130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.817439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.817748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.818098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.818404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.818715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.819031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.819338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.819643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.819948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.820250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.820556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.820861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.821161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.821464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.821763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.822108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.822500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.822734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.823155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.823382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.823650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.823977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.824309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.824654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.824972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.825306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.825637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.825958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.826387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.826591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.826917 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.827232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.827547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.827860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.828180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.828564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.828941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.829258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.834248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.835181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.836119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.836119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.836119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.836556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.836556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.836896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.837205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.837568 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.837876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.838256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.838566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.838891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.839226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.839537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.839871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.840247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.840610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.841356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.841678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.841997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.842334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.842646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.843021 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.843377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.843876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.844301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.844651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.844966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.845286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.846269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.846680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.846951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.847283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.847644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.847957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.848294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.848628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.848775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:30:23.849240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:30:23.849383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.849383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.849649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:30:23.849779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.849907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:30:23.850065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.850210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:30:23.850352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.850491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.850628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.850757 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.850891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.851030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.851158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.851337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.851477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.851670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.851827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.851980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.852121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.852288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.852428 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.852596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.852737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.852886 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.853102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.853242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.853371 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.853505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.853640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.853790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-14-iscsi {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.853936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.854118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.854263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.854425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.854564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.854729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.854861 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.855057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.855195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.855366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.855507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.855693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.855836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.856006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.856138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.856340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.856511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.856675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.856812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.856968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.857114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.857287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.857424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.857600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.857754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.858159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.858302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.858433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.858570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.858706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.858846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.858981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.859110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.859242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.859382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.859510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.859637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.859791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.860019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-14-iscsi {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.860161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.860344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.860477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.860661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.860799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.860980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.861154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.861443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.861586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.862255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.862666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.863005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.863198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.863330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.863457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.863668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.863821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.863961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.864091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.864233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.864361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.864496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.864643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.864779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.864914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.864914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.865154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.865287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.865424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.865424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.865680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.865822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.866274 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.866429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.866559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.866708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.867518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.867685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.867856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.868051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.868193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.868349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.868492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.868641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.868782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.868924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.869064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.869218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.869374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.869524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.869524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.869814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.869977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.870165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.870308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.870462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.870604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.870753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.870910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.871052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.871192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.871339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.871509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.871751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.871916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.872069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.872219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.872368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.872634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.872793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.872935 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.873075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.873205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.873340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.873477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.873624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.873753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.873890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.874065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.874197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.874336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.874479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.874479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.874733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.874862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.875004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.875131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.875254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.875383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.875511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.875511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.875511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.875511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.875511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.876115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.876252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.876380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.876514 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.876680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.876823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.876948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.877151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.877318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.877451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.877588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.877719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.877853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.877989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.878998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.879167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.879294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.879419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.879530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.879649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.879768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.879886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.880016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.880172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.880328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.880473 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.880621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.880773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.880922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.881072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.881552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.881552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.882133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.882306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.882463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.882618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.882761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.882902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.883050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.883203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.883352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.883494 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.883635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.883635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.883907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.884068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.884210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.884360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.884503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.884503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.884787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.884928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.885079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.885221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.885362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.885501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.885651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.885793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.885944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.886109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.886263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.886404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.886599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.886741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.886889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.887038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.887179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.887319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.887458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.887605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.887777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.887930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.888079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.888219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.888370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.888510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.888649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.888780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.888908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.888908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.889147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.889274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.889408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.889544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.889680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.889819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.889948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.890123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.890261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.890391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.890526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.890662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.890827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.891041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.891173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.891309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.891446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.891576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.891714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.891854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.891992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.892141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.892789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.892789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.893099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.893229 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.893349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.893460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.893570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.893570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.893794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.893912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.894050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.894173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:30:23.894302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.894302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.894554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.894683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.894818 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.894946 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.895913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896041 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.896980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.897939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.898278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.898412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.898587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.898721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.898901 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.899040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.899214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.899347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.899527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.899659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.899833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.900120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.900294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.900424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.900566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.900827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.900961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.901863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.902067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.902201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.902390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.902709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.903015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.903255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.903499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.903650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.903821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.903965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.904133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.904294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.904442 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.904613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.904815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.904956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.905102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.905334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910814 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.910928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911509 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911879 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.911990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.912307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.912425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.912618 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.912733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.912874 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.913981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.914127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.914290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.914444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.914595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.914748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.914899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.915042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.915182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.915349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.915505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.915760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.915987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.916137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.916289 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.916440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.916589 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.916731 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.916878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.917902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.918186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.918438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.918657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.918806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.919141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.919290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.919442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.919591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.919745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.919907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.920324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.920485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.920639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.920782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.920923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921945 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.921945 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.922258 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.922409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.922551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.922691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.922831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.922979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.923197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.923342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.923483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.924178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.924329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.924483 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.924635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.924783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.924925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.925072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.925233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.925381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.925537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.925686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.925929 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.926220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.926376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.926533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.926687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.926835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.926976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.927124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.927275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.927425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.927576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.927717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.927865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.928007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.928147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.928301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.928301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.928695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.928913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.929077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.929393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.929552 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.929697 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.929845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.929995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.930162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.930333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.930559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.930714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.930873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.931893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.932933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.933972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.934149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.934293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.934434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.934582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.934747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.934891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.935943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.936170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.936382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.936527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.936683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.936843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.936987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.937983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.938151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.938310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.938452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.938865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.939224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.940038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.940188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.940339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.940482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.940706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.940854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.941919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.942112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.942112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.942412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.942554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.942702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.942851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.943870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.944145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.944285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.944433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.944433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.944724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.944724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.945991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.946173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.946403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.946635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.946784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.946941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947810 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.947950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.948974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.949283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.949428 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.949569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.949751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.949914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.950282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.950448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.950638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.950875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.951907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.952932 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.953156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.953333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.953485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.953627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.953770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.953918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.954188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.954339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.954487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.954487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.954794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.955972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.956128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.956282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.956282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.956734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.956892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.956892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.957184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.957326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.957474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.957622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.957622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.957897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958829 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.958973 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.959276 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.959437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.959579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.959721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.959721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.960001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.960151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.960151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.960632 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.960774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.960774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.961144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.961294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.961442 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.961585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.961585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.961861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.962922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.963209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.963351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.963351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.963633 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.963897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.964083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.964250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.964250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.964550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.964700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.964700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965429 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.965987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.966196 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.966352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.966352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.966736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.966964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.966964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.967246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.967390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.967390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.967674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.967817 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.967957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.968150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.968150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.968444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.968602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.968774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.968956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.969119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.969497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.969661 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.969819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.970092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.970259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.970615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.970776 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.970919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.980239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.980431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.980591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.980591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.980886 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.981920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.982957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.983106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.983106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.983911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.984068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.984068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.986683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.986885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.986885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.987195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.987357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.987357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.987663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.987813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.987813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.988960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.989247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.989390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.989390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.989714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.989858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.989858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.990164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.990315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.990315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.994173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.994357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.994357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.994666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.994815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.994815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.995805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.996979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.997261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.997411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.997411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.997767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.997913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.997913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998509 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.998945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.999224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.999224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.999224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.999224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.999224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:23.999224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.000077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.000226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.000226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.000226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.001132 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.001284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.001438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.001438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.001799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.002487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.002487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.002788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.002931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.002931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.003313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.003465 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.003606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.003756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.003756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.004149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.004296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.004296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.004562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.004737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.004879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.005930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.006100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.006253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.006253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.006551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.006718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.006718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.007779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008671 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.008985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.009271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.009419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.009419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.009704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.009863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.009863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.010193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.010348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.010348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011213 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011213 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.011939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.012100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.012256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.012405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.012703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.012703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.013087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.013408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.013408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.013408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.013935 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.014237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.014237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.014546 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.014740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.014892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.015956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.016259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.016407 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.016562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.016719 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.016719 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.017152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.017842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.018977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.019131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.019131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.019421 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.019576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.019576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.019576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.020006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.020155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.020301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.020457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.020457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.020764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.021290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.021290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.021290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.021793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.021942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.021942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.022260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.022426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.022426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.022719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.022866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.023013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.023013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.023291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.023291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.023728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.023885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.024042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.024195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.024493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.024649 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.024803 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.024958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.025165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.025327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.025486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.025767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.025921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.026175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.026379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.026535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.026732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.026963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.027136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.027367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.027555 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.027711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.027964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.028125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.028284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.028599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.028754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.028901 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.029246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.029402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.029567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.029923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.030361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.030576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.030771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.031344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.031545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.031545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.031907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.032101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.032101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.032464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.032648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.032853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.033167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.033494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.034091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.034091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.034409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.034681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.034850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.035000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.035209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.035365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.035547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.035770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.035944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.036183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.036351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.036502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.036817 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.036971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.037129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.037414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.037581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.037760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.037962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.038166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.038441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.038596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.038754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.039088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.039250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.039408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.039653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.039809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.040048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.040202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.040489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.040756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.040912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.041245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.041564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.041721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.041871 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.042096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.042254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.042413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.042561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.042749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.043045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.043210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.043396 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.043610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.043766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.044066 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.044234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.044392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.044747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.044910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.045061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.045256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.045421 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.045638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.045792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.045950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.046295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.046451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.046614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.046913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.047077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.047227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.047529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.047700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.047872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.048117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.048282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.048458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.049241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.049548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.049917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.050116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.050282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.050555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.050712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.051003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.051159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.051510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.051838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.051989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.052160 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.052332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.052490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.052648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.052798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.053061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.053224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.053539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.053710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.053905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.054212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.054390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.054593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.054755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.055046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.055208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.055446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.055610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.055769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.056094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.056249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.056451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.056708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.056878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.057028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.057267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.057433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.057680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.057850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.058084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.058395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.058553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.058900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.059055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.059210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.059530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.059686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.059835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.060088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.060254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.060470 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.060662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.060914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.061217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.061373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.061858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.062052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.062209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.062209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.062490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.062637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.062855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.063026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.063188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.063507 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.063923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.064094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.064508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.064744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.064929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.065197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.065471 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.065629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.065801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.066159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.066338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.066496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.066652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.066808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.067136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.067293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.067441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.067722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.067948 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.068170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.068323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.068492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.068686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.068840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.069011 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.069332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.069487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.069642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.069925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.070106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.070328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.070524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.070751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.071092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.071248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.071418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.071747 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.072062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.072220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.072377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.072580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.072768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.072934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.073246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.073408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.073573 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.073890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.074077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.074307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.074484 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.074736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.074899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.075056 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.075231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.075484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.075636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.075793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.076072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.076506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.077069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.077639 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.077802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.078137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.078313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.078464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.078804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.078965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.079122 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.079401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.079689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.080518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.080708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.081079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.081241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.081432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.081690 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.082179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.082179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.082499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.082754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.083077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.083394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.083727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.084050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.084366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.084911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.085098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.085305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.085623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.085941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.086279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.086615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.086932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.087247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.087562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.087882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.088199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.088513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.088828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.089144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.089474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.089788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.096517 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.096779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.096963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.097647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.098955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.100139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.101309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.101309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.101309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.101309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.101924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.101924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.103587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.103587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.103587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.103587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.103587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.104338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.104338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.104338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.104627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.104867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.105236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.105513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.105823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.106187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.106514 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.106829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.107526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.107849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.108179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.108509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.108831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.109169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.109504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.109826 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.110204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.110526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.110865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.111798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.112137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.112725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.112988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.113235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.113961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.113961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.114505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.114505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.114976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.114976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.115427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.115716 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.115966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.116220 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.116529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.116844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.117187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.117503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.117823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.118168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.118489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.118808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.119127 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.119472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.119802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.120117 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.120453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.120778 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.121109 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.121435 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.121787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.122126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.122425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.122850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.123106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.123350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.123679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.124406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.124406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.124850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.125126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.125358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.125632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.125952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.126322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.126839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:30:24.127129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:30:24.152326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_db.sqlalchemy.engines [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.236326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.context [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744d09d0-5228-4066-927d-4e439a7622b0(cell1) {{(pid=109037) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:30:24.242431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.242971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.245658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.246843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.249860 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.331596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.context [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744d09d0-5228-4066-927d-4e439a7622b0(cell1) {{(pid=109036) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:30:24.336151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.337799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.338669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.342759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.354806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_db.sqlalchemy.engines [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.356672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_db.sqlalchemy.engines [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.360749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.364446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.653262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.698660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_db.sqlalchemy.engines [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:30:24.994722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: WARNING keystonemiddleware.auth_token [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:30:25.001434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: WARNING keystonemiddleware.auth_token [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:30:25.039760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: WARNING keystonemiddleware.auth_token [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:30:25.046466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: WARNING keystonemiddleware.auth_token [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:30:25.352240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: WARNING keystonemiddleware.auth_token [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:30:25.357544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: WARNING keystonemiddleware.auth_token [None req-7cbd8051-90ab-4d5c-a26f-da03592c30f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:30:25.363567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0ce98d9c0 pid: 109036 (default app) Aug 27 03:30:25.413437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: WARNING keystonemiddleware.auth_token [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:30:25.418640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: WARNING keystonemiddleware.auth_token [None req-2183f42c-b230-4ec0-bfbb-494cade910e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:30:25.424178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0ce98d9c0 pid: 109037 (default app) Aug 27 03:30:59.269021 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-03e94cc3-5442-4195-b2f4-f1c1306bda62 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Action: 'create', calling method: .version_select at 0x7fb13269aca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1421346161"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:00.794608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a59034bd-3abc-4a59-8719-d22bab284e73 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Action: 'create', calling method: .version_select at 0x7fb13264bca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1437060391", "metadata": {"Type": "work"}}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:01.650498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-03e94cc3-5442-4195-b2f4-f1c1306bda62 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.487200 Aug 27 03:31:01.659979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Aug 27 03:30:58 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3498 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:31:01.665711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e37bb50b-71cd-4558-b337-130dafac2334 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb132569700>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:01.774000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e37bb50b-71cd-4558-b337-130dafac2334 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 345 microversion: 2.1 time: 0.110876 Aug 27 03:31:01.774825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:01 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:02.416676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a59034bd-3abc-4a59-8719-d22bab284e73 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.760958 Aug 27 03:31:02.417616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Aug 27 03:30:59 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2765 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:31:02.433149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-09f4af4b-c5e3-4e62-ba61-a71c9602be30 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Calling method '.version_select at 0x7fb132569e50>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:02.533757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-09f4af4b-c5e3-4e62-ba61-a71c9602be30 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2" status: 200 len: 353 microversion: 2.1 time: 0.104075 Aug 27 03:31:02.538143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:02 2021] GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:02.789999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-939e6b0b-fcc3-4d12-b96c-c1c4136e9944 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb13251c700>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:02.934107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-939e6b0b-fcc3-4d12-b96c-c1c4136e9944 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 345 microversion: 2.1 time: 0.150819 Aug 27 03:31:02.934946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 2/5] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:02 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:03.526137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1416051758", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "813150a5-dbda-4897-a617-3b0468d8dcc8"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:03.547570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c1d1f623-3804-4eb9-baa4-f433389a2257 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Calling method '.version_select at 0x7fb13251cd30>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:03.736382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c1d1f623-3804-4eb9-baa4-f433389a2257 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2" status: 200 len: 354 microversion: 2.1 time: 0.192814 Aug 27 03:31:03.737351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:03 2021] GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2 => generated 354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:03.750309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-38dde849-04a8-43ad-b7d5-c562246c1be8 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Calling method '.version_select at 0x7fb1325290d0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:03.782875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] validate_networks() for [('813150a5-dbda-4897-a617-3b0468d8dcc8', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:03.860807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-38dde849-04a8-43ad-b7d5-c562246c1be8 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2" status: 200 len: 354 microversion: 2.1 time: 0.114889 Aug 27 03:31:03.862040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:03 2021] GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:03.880964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f390a0f9-af1b-4966-b250-8f7c21d42e21 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Calling method '.version_select at 0x7fb1325299d0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:04.017866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f390a0f9-af1b-4966-b250-8f7c21d42e21 tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2" status: 202 len: 0 microversion: 2.1 time: 0.141956 Aug 27 03:31:04.021805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Aug 27 03:31:03 2021] DELETE /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:04.025883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-42c0f0fb-9969-41db-b183-d49ef8f6bdd1 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb132529dc0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:04.213611 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-42c0f0fb-9969-41db-b183-d49ef8f6bdd1 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 346 microversion: 2.1 time: 0.192828 Aug 27 03:31:04.214548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 6/9] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:04 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:04.222332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-97bf7fce-f357-4ed0-aebd-96cc809efacd tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Calling method '.version_select at 0x7fb1325294c0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:04.363052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-97bf7fce-f357-4ed0-aebd-96cc809efacd tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2" status: 200 len: 353 microversion: 2.1 time: 0.147103 Aug 27 03:31:04.368250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 7/10] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:04 2021] GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:04.372203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-324cbb35-74f9-44e7-9e84-5accb4fa8f53 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Action: 'create', calling method: .version_select at 0x7fb13251cb80>, body: {"snapshot": {"volume_id": "b9f0d208-bb5e-417c-83da-b3ca8a1a3609", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-716637535"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:04.832354 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-324cbb35-74f9-44e7-9e84-5accb4fa8f53 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.467458 Aug 27 03:31:04.833577 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 8/11] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Aug 27 03:31:04 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:04.843612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-56f5c3b9-89c9-4168-b075-a86605380122 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb13251ce50>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:04.983957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-56f5c3b9-89c9-4168-b075-a86605380122 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 200 len: 286 microversion: 2.1 time: 0.143868 Aug 27 03:31:04.984661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 9/12] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:04 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:04.994692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aa1bdb78-cc83-4e47-b90e-836dc33c837d tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb1325291f0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:05.047125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aa1bdb78-cc83-4e47-b90e-836dc33c837d tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.055954 Aug 27 03:31:05.048885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 10/13] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Aug 27 03:31:04 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:05.059486 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-65ff2683-ce38-4fa2-ade0-b6fd5fa59297 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb13253c1f0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:05.140795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-65ff2683-ce38-4fa2-ade0-b6fd5fa59297 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 200 len: 286 microversion: 2.1 time: 0.085439 Aug 27 03:31:05.141963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:05 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:05.375585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-84e36db7-0c06-480d-b3b6-f4639bd66e7f tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Calling method '.version_select at 0x7fb132529b80>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:05.418764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-84e36db7-0c06-480d-b3b6-f4639bd66e7f tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] HTTP exception thrown: Volume 4f45d4da-5493-40ae-a828-68cc466cdeb2 could not be found. Aug 27 03:31:05.419699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-84e36db7-0c06-480d-b3b6-f4639bd66e7f tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] Returning 404 to user: Volume 4f45d4da-5493-40ae-a828-68cc466cdeb2 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:05.420727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-84e36db7-0c06-480d-b3b6-f4639bd66e7f tempest-VolumesGetTestJSON-1959152764 tempest-VolumesGetTestJSON-1959152764-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2" status: 404 len: 109 microversion: 2.1 time: 0.048686 Aug 27 03:31:05.421347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 12/15] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:05 2021] GET /compute/v2.1/os-volumes/4f45d4da-5493-40ae-a828-68cc466cdeb2 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:31:06.152830 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0c441d6e-65d9-4b3a-85c2-4df14bde1fad tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb132eecd30>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:06.222300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0c441d6e-65d9-4b3a-85c2-4df14bde1fad tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 200 len: 286 microversion: 2.1 time: 0.072802 Aug 27 03:31:06.225528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 13/16] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:06 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:06.432612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:06.433796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:06.434556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:06.435191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:06.435853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:06.480968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:06.490689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:06.494156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:06.496598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:06.503067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1595857801", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "76348684-0746-4695-863f-6c13d586fb3e"}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:06.561552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:06.571743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for user 509234c4194142a4b0634c6f08776161 and project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:06.592403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:06.603243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:06.739963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] validate_networks() for [('76348684-0746-4695-863f-6c13d586fb3e', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:06.799480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7a18a414-a57c-4d84-944e-b5e233e875d1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.509265 Aug 27 03:31:06.802399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 4/17] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 3513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:06.838219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-108da262-4471-4caf-8c44-6c1ba7037912 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:06.851192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-108da262-4471-4caf-8c44-6c1ba7037912 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:07.437677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-108da262-4471-4caf-8c44-6c1ba7037912 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:07.461972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-108da262-4471-4caf-8c44-6c1ba7037912 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1218 microversion: 2.1 time: 0.654332 Aug 27 03:31:07.463734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 5/18] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:06 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1218 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:07.473984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1e3ecdae-2b60-4354-9452-e276beb4ee88 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb131c20820>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:07.535878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1e3ecdae-2b60-4354-9452-e276beb4ee88 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 200 len: 286 microversion: 2.1 time: 0.070876 Aug 27 03:31:07.536881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 6/19] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:07 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:08.480801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-067fc332-8341-4a79-ad3d-71222de5d4fa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:08.481702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-067fc332-8341-4a79-ad3d-71222de5d4fa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:08.710872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-067fc332-8341-4a79-ad3d-71222de5d4fa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:08.718875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-067fc332-8341-4a79-ad3d-71222de5d4fa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1218 microversion: 2.1 time: 0.242571 Aug 27 03:31:08.726617 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 7/20] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:08 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:08.731732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6e6c63fd-268e-4196-a9c2-2f3bc7b926e3 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb131c20670>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:08.797205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6e6c63fd-268e-4196-a9c2-2f3bc7b926e3 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 200 len: 286 microversion: 2.1 time: 0.069154 Aug 27 03:31:08.799212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 8/21] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:08 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:09.204896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:09.205922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:09.206718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:09.207519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:09.208164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:09.246676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.250360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.253788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.255528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.365334 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Getting quotas for project 2133a8c527644f82bfc24e5b135d39d4. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:09.382775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Getting quotas for user 63708acae734472d9c5d4610f54e0fff and project 2133a8c527644f82bfc24e5b135d39d4. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:09.411234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:09.423501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:09.621288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ba925d78-94ca-434d-90e0-06c178e2a774 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.345551 Aug 27 03:31:09.629054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 14/22] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:09.642744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c1ee2b4a-6bd2-4921-9355-b73b20a3ee86 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:09.643843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c1ee2b4a-6bd2-4921-9355-b73b20a3ee86 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:09.882024 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-545025942", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97b5146e-1ead-45fa-b520-237d06579200"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:10.005088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] validate_networks() for [('97b5146e-1ead-45fa-b520-237d06579200', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:10.657719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c1ee2b4a-6bd2-4921-9355-b73b20a3ee86 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:10.696567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c1ee2b4a-6bd2-4921-9355-b73b20a3ee86 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1215 microversion: 2.1 time: 1.065722 Aug 27 03:31:10.706568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 15/23] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:09 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1215 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:10.726955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:10.727847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:10.750108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.750560 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.782743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.787362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.452133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:11.479777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1e3357bb-67ab-4b4e-a9c8-f015efd1853e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1214 microversion: 2.1 time: 0.771092 Aug 27 03:31:11.480863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 16/24] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:10 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1214 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:11.486601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ce5cdab7-45b5-4b69-ae0c-d77e17122da3 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb1313620d0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:11.534950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ce5cdab7-45b5-4b69-ae0c-d77e17122da3 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 200 len: 287 microversion: 2.1 time: 0.052413 Aug 27 03:31:11.535707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 17/25] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:11 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:12.119806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-399f6be3-0840-430f-a348-d5396904e95f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'create', calling method: .version_select at 0x7fb131362ee0>, body: {"keypair": {"name": "tempest-keypair-1398905213"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:12.179699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-399f6be3-0840-430f-a348-d5396904e95f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:12.187619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-399f6be3-0840-430f-a348-d5396904e95f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for user 18f04482c6e04433bbfdfc30616162e4 and project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:12.523184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:12.524015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:12.524214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:12.525004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:12.525648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:12.542678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.543834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.544990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.557530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.592468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Getting quotas for project ffe951b6601f41469ba188c9b4ea1234. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:12.600106 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Getting quotas for user d12fc63838314b0e96fa7939c4bced89 and project ffe951b6601f41469ba188c9b4ea1234. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:12.618309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:12.621521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:12.735681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-410547b4-dd8b-43cc-b8eb-0e98ae274ec6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.298267 Aug 27 03:31:12.743496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 9/26] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:09 2021] POST /compute/v2.1/servers => generated 383 bytes in 3302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:31:12.749586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-89b82a75-e1cc-4061-8d73-f9c52b9f9443 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb131c415e0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.753595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-399f6be3-0840-430f-a348-d5396904e95f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:12.759192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-399f6be3-0840-430f-a348-d5396904e95f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for user 18f04482c6e04433bbfdfc30616162e4 and project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:12.795386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-399f6be3-0840-430f-a348-d5396904e95f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.257980 Aug 27 03:31:12.796373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 18/27] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Aug 27 03:31:11 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:12.820280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.824045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:12.845293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.852181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.853279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.853963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.902599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-89b82a75-e1cc-4061-8d73-f9c52b9f9443 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 202 len: 0 microversion: 2.1 time: 0.161888 Aug 27 03:31:12.904008 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 10/28] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Aug 27 03:31:12 2021] DELETE /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:12.918605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.924400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:12.951991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.953063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.969933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.970583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.063595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:13.077090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f79d5682-d16a-4cc6-a613-0d06e1f00b58 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1275 microversion: 2.1 time: 0.277719 Aug 27 03:31:13.077700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 19/29] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:12 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:13.092943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-74d51aa3-8948-41ab-b3bc-5b242e130392 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:13.093561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-74d51aa3-8948-41ab-b3bc-5b242e130392 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:14.218536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:14.224396 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-74d51aa3-8948-41ab-b3bc-5b242e130392 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:14.232358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-74d51aa3-8948-41ab-b3bc-5b242e130392 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1221 microversion: 2.1 time: 1.153478 Aug 27 03:31:14.233046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 20/30] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:13 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1221 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:14.245681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9b5f722d-d45a-4031-aba7-ad6e5311e035 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1276 microversion: 2.1 time: 1.340401 Aug 27 03:31:14.253580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e797eb7a-191f-4371-81d2-8da1c9132975 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb130aeaf70>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.258968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 11/31] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:12 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1276 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:14.269872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.270833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:14.286531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:14.287718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:14.288779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:14.289605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:14.306374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-e797eb7a-191f-4371-81d2-8da1c9132975 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] HTTP exception thrown: Snapshot 195126ad-f3c5-4d3a-aeca-194dcc458b55 could not be found. Aug 27 03:31:14.306969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e797eb7a-191f-4371-81d2-8da1c9132975 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Returning 404 to user: Snapshot 195126ad-f3c5-4d3a-aeca-194dcc458b55 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:14.309937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e797eb7a-191f-4371-81d2-8da1c9132975 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55" status: 404 len: 111 microversion: 2.1 time: 0.072340 Aug 27 03:31:14.314429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 21/32] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 03:31:14 2021] GET /compute/v2.1/os-snapshots/195126ad-f3c5-4d3a-aeca-194dcc458b55 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:14.319150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e118a1a0-a8b1-4e1a-9b2f-f82c7d0ffb4b tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb130aeab80>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.506535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e118a1a0-a8b1-4e1a-9b2f-f82c7d0ffb4b tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 202 len: 0 microversion: 2.1 time: 0.190897 Aug 27 03:31:14.507358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 22/33] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Aug 27 03:31:14 2021] DELETE /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:14.520169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-215af101-e374-43f9-8396-2da382c1fceb tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb130aea1f0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.618086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:14.629513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e1717013-f699-4261-a20c-abe277b71173 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1273 microversion: 2.1 time: 0.369121 Aug 27 03:31:14.630762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 12/34] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:14 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:14.648360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-149953632", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97b5146e-1ead-45fa-b520-237d06579200"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:14.745673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-215af101-e374-43f9-8396-2da382c1fceb tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 345 microversion: 2.1 time: 0.224859 Aug 27 03:31:14.754549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 23/35] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:14 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 345 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:14.841422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] validate_networks() for [('97b5146e-1ead-45fa-b520-237d06579200', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:15.265808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:15.266781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:15.278038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.279670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.282749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.283982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.479024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:15.486794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c2222efc-2354-4441-821a-0dd59b31088e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1276 microversion: 2.1 time: 0.226834 Aug 27 03:31:15.487605 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 24/36] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:15 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:15.648341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:15.649121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:15.655630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.656293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.657342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.657927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.802693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:15.809959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-96ba29f1-cca7-4b2c-ac68-6262b1a43c96 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1273 microversion: 2.1 time: 0.165183 Aug 27 03:31:15.811018 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 25/37] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:15 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:15.823536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ca72cfb0-5879-456c-816f-0693b3be80e9 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb1325290d0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:15.919927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ca72cfb0-5879-456c-816f-0693b3be80e9 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 345 microversion: 2.1 time: 0.108299 Aug 27 03:31:15.925283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 26/38] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:15 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:16.502841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.503450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:16.520585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.521213 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.522265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.522872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.771414 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:16.793725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:16.795845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-03362abe-bead-41db-8043-4b595735212e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.296328 Aug 27 03:31:16.796968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 27/39] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:16 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:16.807446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:16.808290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:16.808712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:16.809130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:16.825335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.826172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.827182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.827613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.827842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.828530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:16.835564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.836020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.836802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.837240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.848002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Getting quotas for project ffe951b6601f41469ba188c9b4ea1234. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:16.851820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Getting quotas for user d12fc63838314b0e96fa7939c4bced89 and project ffe951b6601f41469ba188c9b4ea1234. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:16.867692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:16.870808 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:16.968806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1c721535-dc76-4bf1-92fc-7c6ad81c43d0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.323398 Aug 27 03:31:16.970435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 13/40] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:14 2021] POST /compute/v2.1/servers => generated 383 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:16.984340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f8deaf38-0279-45e0-a0c4-6c6401fc6791 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb1313b0ee0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.112972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f8deaf38-0279-45e0-a0c4-6c6401fc6791 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 345 microversion: 2.1 time: 0.135171 Aug 27 03:31:17.114368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 14/41] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:16 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:17.119560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-27063bf1-093b-48b6-9d9f-6ee10a401090 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.120455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-27063bf1-093b-48b6-9d9f-6ee10a401090 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:17.393712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-27063bf1-093b-48b6-9d9f-6ee10a401090 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.403759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-27063bf1-093b-48b6-9d9f-6ee10a401090 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1221 microversion: 2.1 time: 0.287792 Aug 27 03:31:17.407539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 15/42] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:17 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1221 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.423367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.432079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6951c3e6-6d6b-4312-88ea-bf6a2f9db389 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.607630 Aug 27 03:31:17.434182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 28/43] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:16 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.812521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.813635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:17.829591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.830047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.830833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.831264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.124834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8912a004-e49f-42fe-a00e-e78f2892c6d7 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb130ad5f70>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.183537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.195404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-56cb9d0a-2623-415b-a258-d3dcbbac810e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.386531 Aug 27 03:31:18.205940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 16/44] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:17 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.279521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8912a004-e49f-42fe-a00e-e78f2892c6d7 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 200 len: 345 microversion: 2.1 time: 0.158121 Aug 27 03:31:18.280208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 29/45] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:18 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:18.425176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.426227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.435389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.440083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.443101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.444322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.453263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.455595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.464510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.469993 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.475741 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.479109 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.681639 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.693905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bd929e7c-4a7f-4cf1-87cb-1093642a24ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.274403 Aug 27 03:31:18.696219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 17/46] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:18 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.771447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.781360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-da192879-e169-41ee-983b-db1ea38fac4a tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.332594 Aug 27 03:31:18.783610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 30/47] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:18 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.108538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1204133101", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c726867b-13f8-4cdb-bf0d-2cd6fe0b7fc4"}], "security_groups": [{"name": "tempest-securitygroup--1782034687"}], "key_name": "tempest-keypair-1398905213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:19.212480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.213085 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:19.221384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.230809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.231637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.232417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.315329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] validate_networks() for [('c726867b-13f8-4cdb-bf0d-2cd6fe0b7fc4', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:19.545766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.559857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0ada82e5-0a74-41f7-8276-e217a7760e7e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.350888 Aug 27 03:31:19.561080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 31/48] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:19 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.571114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-faade6af-3863-42f9-b2f8-614078add86b tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb132529550>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.635414 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-faade6af-3863-42f9-b2f8-614078add86b tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] HTTP exception thrown: Volume b9f0d208-bb5e-417c-83da-b3ca8a1a3609 could not be found. Aug 27 03:31:19.636093 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-faade6af-3863-42f9-b2f8-614078add86b tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Returning 404 to user: Volume b9f0d208-bb5e-417c-83da-b3ca8a1a3609 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:19.637502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-faade6af-3863-42f9-b2f8-614078add86b tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 404 len: 109 microversion: 2.1 time: 0.075070 Aug 27 03:31:19.649136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 32/49] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:19 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:19.655019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b29b3056-ebd1-4eae-8cd5-edc4fc94f218 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb130ad53a0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.725196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-b29b3056-ebd1-4eae-8cd5-edc4fc94f218 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] HTTP exception thrown: Volume b9f0d208-bb5e-417c-83da-b3ca8a1a3609 could not be found. Aug 27 03:31:19.729669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b29b3056-ebd1-4eae-8cd5-edc4fc94f218 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Returning 404 to user: Volume b9f0d208-bb5e-417c-83da-b3ca8a1a3609 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:19.730925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b29b3056-ebd1-4eae-8cd5-edc4fc94f218 tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 404 len: 109 microversion: 2.1 time: 0.080097 Aug 27 03:31:19.732525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 33/50] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Aug 27 03:31:19 2021] DELETE /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:19.748731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.753244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:19.783625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.785881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.788539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.789172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.982585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.993338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3c09eb24-1345-49db-835a-a85e4963cfbe tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.253560 Aug 27 03:31:19.997405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 34/51] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:19 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:20.015024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-12c1057a-0beb-46ed-93f1-e373d96461df tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Calling method '.version_select at 0x7fb130a89d30>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.088690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-12c1057a-0beb-46ed-93f1-e373d96461df tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] HTTP exception thrown: Volume b9f0d208-bb5e-417c-83da-b3ca8a1a3609 could not be found. Aug 27 03:31:20.089674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-12c1057a-0beb-46ed-93f1-e373d96461df tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] Returning 404 to user: Volume b9f0d208-bb5e-417c-83da-b3ca8a1a3609 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:20.090978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-12c1057a-0beb-46ed-93f1-e373d96461df tempest-VolumesSnapshotsTestJSON-1082435797 tempest-VolumesSnapshotsTestJSON-1082435797-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609" status: 404 len: 109 microversion: 2.1 time: 0.092606 Aug 27 03:31:20.095088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 35/52] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:31:19 2021] GET /compute/v2.1/os-volumes/b9f0d208-bb5e-417c-83da-b3ca8a1a3609 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:20.100709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.101615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.109391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.111613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.113883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.114632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.307036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:20.307863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:20.308035 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:20.308383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:20.308788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:20.324326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.324783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.325588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.326040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.380884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:20.390281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for user 18f04482c6e04433bbfdfc30616162e4 and project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:20.413923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:20.416334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:20.459259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.467363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cb4812b8-bc20-4f3c-8571-9ad61bf72ef6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.370785 Aug 27 03:31:20.486433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 36/53] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:20 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:20.524616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b25367ce-a822-4e35-bcca-7f6094fb6e79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.420144 Aug 27 03:31:20.530701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 18/54] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:20.536053 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4d8ebcae-7509-4ecb-9c8e-c4962ba20038 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.536686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4d8ebcae-7509-4ecb-9c8e-c4962ba20038 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.580359 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.580986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.602687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.603232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.604050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.604490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.644377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4d8ebcae-7509-4ecb-9c8e-c4962ba20038 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.651267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4d8ebcae-7509-4ecb-9c8e-c4962ba20038 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1238 microversion: 2.1 time: 0.119391 Aug 27 03:31:20.661530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 37/55] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:20 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:20.919024 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.929045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1a57329d-02d7-482a-8b76-1898d51f2c8c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.352932 Aug 27 03:31:20.939961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 19/56] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:20 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.018682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.019711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.026405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.027161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.028174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.028844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.168324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.184270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-da134c3b-b427-4174-b419-a0a3ae9f34f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.169261 Aug 27 03:31:21.186408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 38/57] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.505144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.506436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.519541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.520170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.522077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.522692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.671819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.674275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.685369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.688538 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.695337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.695977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.834577 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.850946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-379f9a48-85c9-4b70-b641-350a76e64418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.185645 Aug 27 03:31:21.852214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 39/58] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.861751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.869586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c82b3c9c-07a6-40e8-bc2a-0dc88cef7dcf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.368552 Aug 27 03:31:21.873634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 20/59] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.945869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.946534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.960279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.960784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.961614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.962094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.131298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.138630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2fbb2bc1-a92e-434f-bd4a-287de53f9731 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.196594 Aug 27 03:31:22.139127 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 40/60] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:22.212894 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.214399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:22.223471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.224520 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.225474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.226078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.327926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.348794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-44290ab6-f561-446f-a815-bea9029d5b4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.140526 Aug 27 03:31:22.349786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 21/61] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:22 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:22.870594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.871316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:22.888163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.888717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.889596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.891860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.892981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.893101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:22.903052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.903513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.904769 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.905216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.070863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.083039 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6ebcc31c-5e6b-46e3-a2c9-7bb503452d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.217132 Aug 27 03:31:23.086394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 41/62] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:22 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.156330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.157185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.179379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.181212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.182972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.184835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.211236 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.224193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e771532a-b1db-4d8a-bdb7-fd458671515d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.336598 Aug 27 03:31:23.225709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 22/63] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:22 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.368197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.371524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.385338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.390122 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.395292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.396161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.471819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.483995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4445fbb1-bb3e-41dd-b0af-15670d57bd2c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.330366 Aug 27 03:31:23.486537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 42/64] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:23 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:23.565701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.583930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-54ac14d3-1d37-4bb8-bf49-ed84b7040506 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.221760 Aug 27 03:31:23.584933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 23/65] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:23 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.104828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.106236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.116355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.117211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.118644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.119647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.208147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.226056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-18995977-473b-4ec0-bf1f-ab04c3e7bf49 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.126369 Aug 27 03:31:24.226056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 43/66] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:24 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.241577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.244705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.254712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.255556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.256668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.257244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.496200 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.509336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.510162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.515791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b9f77a4e-d380-4d8a-9130-fb9c46e4194e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.275921 Aug 27 03:31:24.517766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 24/67] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:24 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.534459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.535857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.537858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.540083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.600953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.601818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.614180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.615947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.620464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.620923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.771325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.779408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7695c563-f2d2-4116-bfe7-a6b90e78f829 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.182008 Aug 27 03:31:24.790456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 25/68] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:24 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.858099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.876697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ab52ae58-f484-42bd-af74-ee525d53ab8a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.371049 Aug 27 03:31:24.877513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 44/69] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:24 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.253063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.255074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.262746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.264742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.266532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.267381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.368548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.374610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6dab7a1e-4aad-4b79-87c6-f8096433e855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.126071 Aug 27 03:31:25.375831 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 26/70] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:25 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.533510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.534478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.541753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.542389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.546932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.547795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.686389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.695665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bc6a1720-6065-4ba9-9801-22b4801c3c34 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.166440 Aug 27 03:31:25.696335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 45/71] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:25 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.796247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.796887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.803531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.804319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.805748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.806223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.893551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.893709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.894236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.902176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.902558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-eed1a3d5-8d8f-409a-8a1d-0523273d23bd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.110301 Aug 27 03:31:25.902686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.903551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 27/72] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:25 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.916365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.917063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.052452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.061231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-48fdaa91-2e05-49c4-8bb8-5522360e41e0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.171443 Aug 27 03:31:26.070134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 46/73] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:25 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:26.391924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.393186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.398642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.399177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.400022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.400457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.467662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.478365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-54dc6c8f-91c0-4eb2-8318-6acffbdc75b7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.090659 Aug 27 03:31:26.479209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 28/74] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:26 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:26.713338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.713961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.728243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.728860 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.731932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.732379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.876792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.884556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6389c7ab-a333-42aa-978a-49e38c754f37 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.175349 Aug 27 03:31:26.895238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 47/75] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:26 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.919857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.920519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.927406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.927735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.929338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.930201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.047230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:27.056405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b00ad552-85e4-473f-bfa1-b2c2ec39d28a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.140460 Aug 27 03:31:27.056982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 29/76] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:26 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:27.077994 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.079219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:27.085219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.085668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.086481 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.086912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.224047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:27.232170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cd25969c-c2ca-4c48-a453-af0986997c36 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.157696 Aug 27 03:31:27.233148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 48/77] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:27 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:27.495183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.495795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:27.502839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.503307 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.504053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.504489 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.570142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:27.582678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b247ff06-dd67-45c9-b223-a353340f34a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.090655 Aug 27 03:31:27.583640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 30/78] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:27 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:27.901547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.902182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:27.908719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.909162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.909945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.910390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.027463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.036041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-36fcf75a-88b5-40c0-9da3-d82d039be2c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.138186 Aug 27 03:31:28.036696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 49/79] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:27 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.075040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.075839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:28.082142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.082601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.083381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.083820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.146486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.153495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4afdbee2-c21a-4489-a0c2-5362b135cdb7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.082137 Aug 27 03:31:28.154064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 31/80] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:28 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.249762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.250655 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:28.257310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.257749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.258576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.259919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.390426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.409363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a23a1876-93c9-4767-87e2-7ad3cef4e7e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.164389 Aug 27 03:31:28.409957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 50/81] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:28 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.601740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.602395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:28.608094 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.608535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.609302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.610164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.676253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.684741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e78e833d-0e23-47d9-a9f3-442b0e817ee3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.086800 Aug 27 03:31:28.685899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 32/82] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:28 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.054003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.055739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.062505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.064615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.065668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.066325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.171267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.172907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.196264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.200310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.200800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.201306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.233300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.243630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ca44be0c-4db7-44dc-b46a-891962e34b79 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.193743 Aug 27 03:31:29.244209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 51/83] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:29 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.279764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.287110 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-09a5adfc-c77e-4427-a4ca-7bbb1094d711 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.120142 Aug 27 03:31:29.287680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 33/84] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:29 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:29.427259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.427870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.433588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.434042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.434834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.435249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.579366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.588231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b491bcac-8b68-4faf-b33e-cebe8dd17d80 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.164829 Aug 27 03:31:29.588834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 52/85] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:29 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:29.703390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.705448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.711756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.712469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.713657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.714342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.777412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.790334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-175990d6-15bd-4783-b63f-89ca6192d6b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.090692 Aug 27 03:31:29.790900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 34/86] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:29 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:30.260847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.261464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.267495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.267937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.268707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.269137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.303770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.304376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.310251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.310774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.311615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.312127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.395103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.402736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-420a37c1-ac3a-435a-bd96-dfb3ac687f3a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1225 microversion: 2.1 time: 0.102532 Aug 27 03:31:30.403542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 35/87] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:30 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.416076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.425044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-847c63c4-66ca-4118-be7c-826cf327b36d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.167778 Aug 27 03:31:30.425763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 53/88] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:30 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.605467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.606807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.613323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.613761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.614542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.614968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.738051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.745647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-68502bce-0bae-4961-8312-3e4630eb63f5 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.143745 Aug 27 03:31:30.756594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 36/89] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:30 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.808932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.809469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.816317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.816764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.817558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.817971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.889575 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.896905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8a8dda84-1412-4268-93e9-c8bda284c865 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1242 microversion: 2.1 time: 0.091706 Aug 27 03:31:30.897409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 54/90] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:30 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.421379 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.423160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.435640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.452234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.452867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.468216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.469720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.470374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.491991 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.494681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.496772 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.500823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.636504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.644850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c0f8576a-aece-4ef5-8ac2-a735f761f6b1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1273 microversion: 2.1 time: 0.228769 Aug 27 03:31:31.645517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 37/91] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.764460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.766120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.773714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.774483 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.775504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.776198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.821541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.829298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9e815f43-d13a-4e3d-a66f-c5a77f7e0556 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.392450 Aug 27 03:31:31.832530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 55/92] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:31.914311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.915139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.927348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.928019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.928863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.929292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.236195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.249357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e2e0a099-3c53-458a-bca7-178006346f13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1234 microversion: 2.1 time: 0.339163 Aug 27 03:31:32.250701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 56/93] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1234 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:32.396707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.409692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9415d088-8bff-4341-96b2-7af7c3dfbdd7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.648557 Aug 27 03:31:32.421974 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 38/94] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:32.664832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.666152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:32.674333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.675287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.676709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.677578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.847373 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.848728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:32.861671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.863020 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.864089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.864935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.869051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.884190 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-88af70ca-d621-42c7-8bf2-a76b7fa982a5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1279 microversion: 2.1 time: 0.223325 Aug 27 03:31:32.885418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 57/95] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:32 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:33.287119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:33.296671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7f7499df-0fc7-4f83-828c-b2566e5ec5c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.454113 Aug 27 03:31:33.299578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 39/96] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:32 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:33.305084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-480834246", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "fe7821d0-97cf-441e-beed-217d20735215"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:33.450395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] validate_networks() for [('fe7821d0-97cf-441e-beed-217d20735215', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:33.461556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-56c5e41b-12cf-4caf-90dc-352e65e518b0 req-9a22b3c1-83c1-4ac1-85bb-fc0e70987605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bef536a-d819-4f5b-b397-f7f0d19dc976", "tag": "253b001d-b392-41bf-b919-b49c1e9c5699"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:33.464370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:33.464370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:31:33.475570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-56c5e41b-12cf-4caf-90dc-352e65e518b0 req-9a22b3c1-83c1-4ac1-85bb-fc0e70987605 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.476216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-56c5e41b-12cf-4caf-90dc-352e65e518b0 req-9a22b3c1-83c1-4ac1-85bb-fc0e70987605 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.499275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-56c5e41b-12cf-4caf-90dc-352e65e518b0 req-9a22b3c1-83c1-4ac1-85bb-fc0e70987605 service nova] Creating event network-changed:253b001d-b392-41bf-b919-b49c1e9c5699 for instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 on hv-cinder-77398 Aug 27 03:31:33.499970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-56c5e41b-12cf-4caf-90dc-352e65e518b0 req-9a22b3c1-83c1-4ac1-85bb-fc0e70987605 service nova] Acquired lock "compute-rpcapi-router" {{(pid=109037) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 03:31:33.501510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.502152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.503611 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.504726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.515343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.compute.rpcapi [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 03:31:33.517259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] Releasing lock "compute-rpcapi-router" {{(pid=109037) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 03:31:33.560004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b741b122-48b8-45bd-91e6-46ae6c87ace0 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510049 Aug 27 03:31:33.566786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 58/97] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:33.571488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.572199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:33.586974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.587868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.589203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.590282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.763856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:33.779322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1dab629a-ca1f-4e0d-8feb-b91d2904eb20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1296 microversion: 2.1 time: 0.210171 Aug 27 03:31:33.784687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 59/98] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:33 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1296 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:33.795992 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.798724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:33.810130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.810842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.811831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.813712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.444345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.458652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cc708b3c-621f-4065-adde-d344424634bb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.670507 Aug 27 03:31:34.459585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 60/99] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:33 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:34.474619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.475736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:34.485394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.485841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.486808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.487390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.034854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:35.036491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:35.037870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:35.038563 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:35.039515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:35.064754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.065348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.066759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.067424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.090871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Getting quotas for project cda0da7bc3bd48d7b12cbc7e6f823b71. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:35.098613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Getting quotas for user 0002b515bf354a6a83e5cad533c3e292 and project cda0da7bc3bd48d7b12cbc7e6f823b71. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:35.120717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:35.127318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:35.151758 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.182466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee6682f9-b388-4bbd-b339-9d1077a69330 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.703164 Aug 27 03:31:35.195038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 61/100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:34 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.202095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.203902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:35.213046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.213768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.218399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.218399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.309702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2df2ffde-e00d-428a-aaf5-3c55fc4bf711 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007202 Aug 27 03:31:35.313605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 40/101] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:35.353226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.354000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:35.361185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.362247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.363256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.363862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.851732 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.859459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0d4cf4ac-421a-451c-bbb4-ad8cde43b89c tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.662530 Aug 27 03:31:35.862532 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 62/102] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:35 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.878488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7ab41736-4c1b-4440-a34a-4235ce17e674 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.879090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7ab41736-4c1b-4440-a34a-4235ce17e674 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:36.025340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7ab41736-4c1b-4440-a34a-4235ce17e674 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.032476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7ab41736-4c1b-4440-a34a-4235ce17e674 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1213 microversion: 2.1 time: 0.156826 Aug 27 03:31:36.033991 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 63/103] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:35 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.061451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.064528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:36.072440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.081353 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.082674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.083788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.084564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.087566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-37e57b2d-7693-43bc-8aea-99eb01c451a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.768850 Aug 27 03:31:36.088386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 41/104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:35 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.098651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-ee817de7-cb23-4337-ac8a-cc0384e5ad3f req-a8cbc178-c7c6-4481-8a87-2b25a72db976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8d878f-cb25-4cd8-b690-81e8698f2a1f", "tag": "34897c05-7eef-4339-91c9-e3bfd1114a68"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:36.101082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:36.101082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:36.124950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ee817de7-cb23-4337-ac8a-cc0384e5ad3f req-a8cbc178-c7c6-4481-8a87-2b25a72db976 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.126219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ee817de7-cb23-4337-ac8a-cc0384e5ad3f req-a8cbc178-c7c6-4481-8a87-2b25a72db976 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.158168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-ee817de7-cb23-4337-ac8a-cc0384e5ad3f req-a8cbc178-c7c6-4481-8a87-2b25a72db976 service nova] Creating event network-changed:34897c05-7eef-4339-91c9-e3bfd1114a68 for instance 2b8d878f-cb25-4cd8-b690-81e8698f2a1f on hv-cinder-77398 Aug 27 03:31:36.162874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ee817de7-cb23-4337-ac8a-cc0384e5ad3f req-a8cbc178-c7c6-4481-8a87-2b25a72db976 service nova] Acquired lock "compute-rpcapi-router" {{(pid=109036) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 03:31:36.164350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.165012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.166184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.167881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.185772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.compute.rpcapi [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 03:31:36.187136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] Releasing lock "compute-rpcapi-router" {{(pid=109036) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 03:31:36.225510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e991cc9f-e9a9-476b-b53d-090db9141b26 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135135 Aug 27 03:31:36.226334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 42/105] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:36.256796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.257880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:36.279762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.281703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.283287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.297445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.526410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.536440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b2370b85-59bb-4666-a091-97654b234e7c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.487116 Aug 27 03:31:36.546802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 64/106] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:36 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.785619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.810395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-173bf440-2aeb-455d-8c4d-4143a2b2650e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.581441 Aug 27 03:31:36.822703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 43/107] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:36 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.882192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.884336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:36.896496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.898154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.903001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.905142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.054314 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.055189 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.067481 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.068563 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.069560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.070251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.280149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.290722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cb62a7e6-cb06-4964-8c1e-c1f35018f1c5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1271 microversion: 2.1 time: 0.241707 Aug 27 03:31:37.291926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 44/108] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:37.448181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-1a89aebf-f9cc-4af2-a02e-b50353e4a102 req-6994261d-fbde-4710-ad13-f5502259cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248b6ca4-52d6-42f2-8ab8-823ee2872a2c", "tag": "9a6e660c-1d4b-4a72-9ee8-af4d5608ba4d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:37.450078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:37.450078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:37.461672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-1a89aebf-f9cc-4af2-a02e-b50353e4a102 req-6994261d-fbde-4710-ad13-f5502259cf2a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.465665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-1a89aebf-f9cc-4af2-a02e-b50353e4a102 req-6994261d-fbde-4710-ad13-f5502259cf2a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.489146 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-1a89aebf-f9cc-4af2-a02e-b50353e4a102 req-6994261d-fbde-4710-ad13-f5502259cf2a service nova] Creating event network-changed:9a6e660c-1d4b-4a72-9ee8-af4d5608ba4d for instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c on hv-cinder-77398 Aug 27 03:31:37.510079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-1a89aebf-f9cc-4af2-a02e-b50353e4a102 req-6994261d-fbde-4710-ad13-f5502259cf2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212392 Aug 27 03:31:37.510985 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 45/109] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:37.518976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.519710 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.541381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.541832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.542850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.543234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.695193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.703164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d85c6fb7-2848-420b-b80e-74a8ed596fe9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.828092 Aug 27 03:31:37.707594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 65/110] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:36 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.719685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.720309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.731570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.732029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.732812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.733239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.190717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.201976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1c441ba2-2a39-4262-8053-2f13e31a18fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.689751 Aug 27 03:31:38.204298 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 46/111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.205130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.215637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0a0f7d70-ad5e-4725-b075-60967daf248f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.505295 Aug 27 03:31:38.216299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.217217 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 66/112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.218380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:38.238263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.239488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.241735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.244415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.309373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.310292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:38.317994 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.318634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.319579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.320167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.537206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.545586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e43fc051-9dc0-4782-9347-7d101707ba80 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1271 microversion: 2.1 time: 0.240674 Aug 27 03:31:38.549942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 67/113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:38 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1271 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:38.559901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-05f8bb0f-73c6-4c76-b7ea-860849d092ff req-8973e80f-7c86-48a3-8f33-32b513abfbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "356e4fdd-62a5-42e5-bb50-a576d9338e22", "tag": "dc3cad3e-acbe-4108-9aaf-10f03aebdb4f"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:38.566770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:38.566770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:31:38.588034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-05f8bb0f-73c6-4c76-b7ea-860849d092ff req-8973e80f-7c86-48a3-8f33-32b513abfbd0 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.588477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-05f8bb0f-73c6-4c76-b7ea-860849d092ff req-8973e80f-7c86-48a3-8f33-32b513abfbd0 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.622272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-05f8bb0f-73c6-4c76-b7ea-860849d092ff req-8973e80f-7c86-48a3-8f33-32b513abfbd0 service nova] Creating event network-changed:dc3cad3e-acbe-4108-9aaf-10f03aebdb4f for instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 on hv-cinder-77398 Aug 27 03:31:38.632205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-05f8bb0f-73c6-4c76-b7ea-860849d092ff req-8973e80f-7c86-48a3-8f33-32b513abfbd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080469 Aug 27 03:31:38.641148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 68/114] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:38.724641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.726253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:38.740334 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.741684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.743700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.744921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.829609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.840416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5d1f47c6-478b-482b-b3ae-6dc6e4a42aff tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.633832 Aug 27 03:31:38.854161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 47/115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:38 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:39.220183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.220797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:39.236555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.237002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.237789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.238249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.293536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.309985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e52b1cc4-ffce-4bc7-a449-b7fb73bfd36e tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.587617 Aug 27 03:31:39.324626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 69/116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:38 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:39.329972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.333046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:39.349436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.349893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.350711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.351147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.927759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.935775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b7571ebf-93f0-4d29-9f1d-1a1d8b1a0a3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.719694 Aug 27 03:31:39.936352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 48/117] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:39 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:39.941851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.942673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:39.948600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.949258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.949986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.950440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.055387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.065429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fcd6a184-b8ac-4f0e-b720-3175d9bf3cfa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.738407 Aug 27 03:31:40.067280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 70/118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:39 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.084603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-dee2ec85-32ef-4086-b82f-2a4fa58db397 req-12cb3d82-1d1a-4989-b4c3-6748adef7401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef870f4c-a749-484d-a466-9be119c21dbf", "tag": "212f95d8-459a-4da3-a611-d44a86cc8028"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:40.089633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:40.089633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:31:40.099313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-dee2ec85-32ef-4086-b82f-2a4fa58db397 req-12cb3d82-1d1a-4989-b4c3-6748adef7401 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.100191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-dee2ec85-32ef-4086-b82f-2a4fa58db397 req-12cb3d82-1d1a-4989-b4c3-6748adef7401 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.118787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-dee2ec85-32ef-4086-b82f-2a4fa58db397 req-12cb3d82-1d1a-4989-b4c3-6748adef7401 service nova] Creating event network-changed:212f95d8-459a-4da3-a611-d44a86cc8028 for instance ef870f4c-a749-484d-a466-9be119c21dbf on hv-cinder-77398 Aug 27 03:31:40.127020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-dee2ec85-32ef-4086-b82f-2a4fa58db397 req-12cb3d82-1d1a-4989-b4c3-6748adef7401 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056770 Aug 27 03:31:40.127733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 71/119] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:40.133346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.134097 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.141540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.142084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.142969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.143456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.216620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.226793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-93411d97-4129-4320-af5e-343dc7b13dc8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.288663 Aug 27 03:31:40.229339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 49/120] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:39 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.327953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.328571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.335357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.336107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.336897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.337332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.793757 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.804440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9d24dbca-4cdd-4543-aadd-68dba7acc059 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.675194 Aug 27 03:31:40.805016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 72/121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.874172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.883185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4327a41c-2555-4e83-aebe-e5d018f17749 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.559015 Aug 27 03:31:40.890309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 50/122] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.953718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.954370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.962887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.963378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.964076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.964500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.084964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.085652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:41.098055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.099914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.101570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.102008 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.499398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.508808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1794817b-19de-45a1-97b6-d1a966bcf9f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.559318 Aug 27 03:31:41.510174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 73/123] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.514971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.516266 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:41.529835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.533064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.533895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.534846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.633780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.643893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2bd8b21d-6890-43f8-a365-25cb300de2ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.562863 Aug 27 03:31:41.654912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 51/124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:41 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:41.825113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.825741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:41.842582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.843873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.844880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.845516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.863606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.873261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a8e9e8ca-1a79-4395-8437-2f6c8573556c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.361845 Aug 27 03:31:41.873903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 74/125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:41 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.907237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.908107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:41.914638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.915299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.916272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.917141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.171247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.185231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c8b3f07a-b93d-4183-bc11-7d1476963157 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.366491 Aug 27 03:31:42.186372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 52/126] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:41 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:42.208315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-c0efa6b8-54f6-46b2-82a6-9386c7ada064 req-b8e1a1a2-a416-4ac3-a039-358aa5ecd646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9191928e-b1c1-481f-9776-cca8c77072bb", "tag": "1641ee30-e418-421e-8d68-0dc10e0eeba4"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:42.213574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:42.213574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:42.218291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.227974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6b1c2405-8cc4-4634-8bcb-a8a34559d30d tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.325495 Aug 27 03:31:42.228559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 75/127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:41 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:42.234834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c0efa6b8-54f6-46b2-82a6-9386c7ada064 req-b8e1a1a2-a416-4ac3-a039-358aa5ecd646 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.235677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c0efa6b8-54f6-46b2-82a6-9386c7ada064 req-b8e1a1a2-a416-4ac3-a039-358aa5ecd646 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.251132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-c0efa6b8-54f6-46b2-82a6-9386c7ada064 req-b8e1a1a2-a416-4ac3-a039-358aa5ecd646 service nova] Creating event network-changed:1641ee30-e418-421e-8d68-0dc10e0eeba4 for instance 9191928e-b1c1-481f-9776-cca8c77072bb on hv-cinder-77398 Aug 27 03:31:42.257310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-c0efa6b8-54f6-46b2-82a6-9386c7ada064 req-b8e1a1a2-a416-4ac3-a039-358aa5ecd646 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067065 Aug 27 03:31:42.258721 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 53/128] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:42.527272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.527875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:42.535194 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.536274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.538559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.539315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.661328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.662162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:42.675551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.676088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.676934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.677422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.050027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.058238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-915f4499-2ecf-42cc-a0e3-41dd9302be6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.535235 Aug 27 03:31:43.061090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.069346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 76/129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:42 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.069638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-023a8559-5f4b-43e8-88d9-f5e8254b5dce tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.412475 Aug 27 03:31:43.070227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 54/130] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:42 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.074564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.075486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.081711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.082184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.083117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.083686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.232832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-e6734bef-882a-4fa0-b2ba-6e0375f1d7df req-1dcb9e11-a44d-4733-962f-a210e7bc8603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8d878f-cb25-4cd8-b690-81e8698f2a1f", "name": "network-vif-plugged", "status": "completed", "tag": "34897c05-7eef-4339-91c9-e3bfd1114a68"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:43.236060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:43.236060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:31:43.247808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-e6734bef-882a-4fa0-b2ba-6e0375f1d7df req-1dcb9e11-a44d-4733-962f-a210e7bc8603 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.248362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-e6734bef-882a-4fa0-b2ba-6e0375f1d7df req-1dcb9e11-a44d-4733-962f-a210e7bc8603 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.271312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-e6734bef-882a-4fa0-b2ba-6e0375f1d7df req-1dcb9e11-a44d-4733-962f-a210e7bc8603 service nova] Creating event network-vif-plugged:34897c05-7eef-4339-91c9-e3bfd1114a68 for instance 2b8d878f-cb25-4cd8-b690-81e8698f2a1f on hv-cinder-77398 Aug 27 03:31:43.286522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-e6734bef-882a-4fa0-b2ba-6e0375f1d7df req-1dcb9e11-a44d-4733-962f-a210e7bc8603 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214239 Aug 27 03:31:43.291675 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 77/131] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:43.303379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.308145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.318541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.319429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.320348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.320951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.342338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.353748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3cd789b5-8e26-4f98-aef5-fc741337f0ef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.281314 Aug 27 03:31:43.355235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 55/132] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.364275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.368288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.377514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.378257 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.379360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.380025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.731963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.744452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e74502b3-b126-46d0-8b7b-9efb2f145461 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.451180 Aug 27 03:31:43.745033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 78/133] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.944958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.953178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-39c69e22-1643-4c5c-b991-0a9c6abb8219 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.595857 Aug 27 03:31:43.954298 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 56/134] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.075933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.079257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.086816 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.087590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.088070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.088683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.089119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.089443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.097983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.098962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.100048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.100622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.389160 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.392822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.402146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0335171f-6122-4479-92f7-8c290159b3aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.329853 Aug 27 03:31:44.402892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 79/135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.403916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bb0e3091-0cbd-467b-bc80-a05fe7c07c1b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.320608 Aug 27 03:31:44.405002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 57/136] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:44.409795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.410679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.427533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.428512 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.429524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.430124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.635702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.644472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f6546ec9-36dd-4346-bdad-14060fbe31f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.240452 Aug 27 03:31:44.646309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 80/137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.760285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.760906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.768122 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.768572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.769355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.769789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.916329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.926053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-228d80aa-f316-41a6-a79a-02046e80c71a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.168417 Aug 27 03:31:44.927943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 58/138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.971069 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.971681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.980527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.983216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.984021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.984584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.135849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.151913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3c0b2e9d-180d-4fff-94fc-a582fe71b254 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.185569 Aug 27 03:31:45.153028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 81/139] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.332364 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-2597807a-8e55-4aa2-81a6-2eb560d05b04 req-e7872693-5a99-419b-a0a9-862c7ba8b486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef536a-d819-4f5b-b397-f7f0d19dc976", "name": "network-vif-plugged", "status": "completed", "tag": "253b001d-b392-41bf-b919-b49c1e9c5699"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:45.335660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:45.335660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:45.350194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-2597807a-8e55-4aa2-81a6-2eb560d05b04 req-e7872693-5a99-419b-a0a9-862c7ba8b486 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.351229 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-2597807a-8e55-4aa2-81a6-2eb560d05b04 req-e7872693-5a99-419b-a0a9-862c7ba8b486 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.377965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-2597807a-8e55-4aa2-81a6-2eb560d05b04 req-e7872693-5a99-419b-a0a9-862c7ba8b486 service nova] Creating event network-vif-plugged:253b001d-b392-41bf-b919-b49c1e9c5699 for instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 on hv-cinder-77398 Aug 27 03:31:45.386164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-2597807a-8e55-4aa2-81a6-2eb560d05b04 req-e7872693-5a99-419b-a0a9-862c7ba8b486 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059984 Aug 27 03:31:45.387034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 59/140] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:45.425946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.426822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.427801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.428634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.438616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.442444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.443259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.443841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.444812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.445726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.446330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.447064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.719844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.728241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8f4c5bb2-d17f-416d-85b7-e23e419f1219 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.310458 Aug 27 03:31:45.729000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 82/141] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.742935 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.743865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.749708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.750411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.751490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.752082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.755664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.763441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-34eb7f4a-3155-4d86-ae1b-3fb823eb3b1e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.346577 Aug 27 03:31:45.764202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 60/142] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.900786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.907022 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-72f23eec-d85c-4e22-af93-c8b5ae328f09 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.166905 Aug 27 03:31:45.907606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 83/143] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.942429 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.943048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.948959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.949412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.950219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.950657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.122381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.133203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6c775246-6f3d-458b-bd20-cf58f2184e79 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.194251 Aug 27 03:31:46.143447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 61/144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.170102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.171277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:46.178507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.179203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.180215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.182136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.415214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.423695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-31d53185-9a70-4b85-aba7-7dfdf0b00e1b tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.257738 Aug 27 03:31:46.424279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 84/145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:46 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.744345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.744948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:46.753389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.753807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.754746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.755178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.780209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.780828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:46.789858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.790356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.792883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.793593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.035069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.038570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.043082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-aa58a73e-cf3c-468e-815f-ace479770a41 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.302243 Aug 27 03:31:47.052987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 62/146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:46 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.053249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c48ab4f8-b2c9-4aaa-8e7d-1b3f3f29cfe2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1318 microversion: 2.1 time: 0.270931 Aug 27 03:31:47.053342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.053342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.053488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 85/147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:46 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:47.064802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.065331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.066178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.066611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.152606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.153633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.166260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.169242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.171335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.172150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.298036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.307389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c8e8b2ac-8833-4455-8c1e-468e12658bd8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.260996 Aug 27 03:31:47.308329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 63/148] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.371910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.380121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-16ea3ed7-b264-4644-9770-43812b1fc1f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.232840 Aug 27 03:31:47.380707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 86/149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:47.407683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-45ecd1dd-8634-45fc-aad9-611d7221d9ac req-a179168c-3479-4b12-8beb-e0ea8e24f65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248b6ca4-52d6-42f2-8ab8-823ee2872a2c", "name": "network-vif-plugged", "status": "completed", "tag": "9a6e660c-1d4b-4a72-9ee8-af4d5608ba4d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:47.409471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:47.409471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:47.416615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-45ecd1dd-8634-45fc-aad9-611d7221d9ac req-a179168c-3479-4b12-8beb-e0ea8e24f65f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.417054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-45ecd1dd-8634-45fc-aad9-611d7221d9ac req-a179168c-3479-4b12-8beb-e0ea8e24f65f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.428158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-45ecd1dd-8634-45fc-aad9-611d7221d9ac req-a179168c-3479-4b12-8beb-e0ea8e24f65f service nova] Creating event network-vif-plugged:9a6e660c-1d4b-4a72-9ee8-af4d5608ba4d for instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c on hv-cinder-77398 Aug 27 03:31:47.433425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-45ecd1dd-8634-45fc-aad9-611d7221d9ac req-a179168c-3479-4b12-8beb-e0ea8e24f65f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029467 Aug 27 03:31:47.437181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 64/150] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:47.441420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.442163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.447908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.448341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.449099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.449515 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.626831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.636976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-86928a25-c7a5-4751-baf1-9aad75b6d034 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1315 microversion: 2.1 time: 0.199276 Aug 27 03:31:47.637858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 87/151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.061236 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.062030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.067692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.068729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.073594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.076775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.079754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.080301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.080560 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.081061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.081339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.081773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.362176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.376103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.384094 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ff24ac7d-4e23-4ee4-b96f-78aff931c75e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.327291 Aug 27 03:31:48.385085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 65/152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.390068 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.391913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.400620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.401388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.402546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.403125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.407868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-91145d9a-93de-4116-b519-b1c092183d5b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1508 microversion: 2.1 time: 0.320946 Aug 27 03:31:48.422900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 88/153] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.432885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.433909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.453856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.456695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.459092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.461572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.669129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.679839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3059e2a7-c78d-4217-abaa-08da44a44d97 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.293607 Aug 27 03:31:48.680508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 66/154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.704625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.705629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.711824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.712274 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.713099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.713535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.752780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.761176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c4d4bfbc-f010-4f06-b010-718194fc7c24 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.336582 Aug 27 03:31:48.762050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 89/155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.879768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.887221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fd5d948e-8180-4aa2-9fc7-3a9f38566fa9 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1502 microversion: 2.1 time: 0.193095 Aug 27 03:31:48.887777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 67/156] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.400777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.402456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.412624 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.413399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.414832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.415329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.456852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-d009e054-a26b-4242-9cb5-333e874f768f req-ab363f80-fce4-44a3-a84e-28b5ca3a9848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356e4fdd-62a5-42e5-bb50-a576d9338e22", "name": "network-vif-plugged", "status": "completed", "tag": "dc3cad3e-acbe-4108-9aaf-10f03aebdb4f"}, {"server_uuid": "ef870f4c-a749-484d-a466-9be119c21dbf", "name": "network-vif-plugged", "status": "completed", "tag": "212f95d8-459a-4da3-a611-d44a86cc8028"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:49.457711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:49.457711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:49.479651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-d009e054-a26b-4242-9cb5-333e874f768f req-ab363f80-fce4-44a3-a84e-28b5ca3a9848 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.485706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-d009e054-a26b-4242-9cb5-333e874f768f req-ab363f80-fce4-44a3-a84e-28b5ca3a9848 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.522445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-d009e054-a26b-4242-9cb5-333e874f768f req-ab363f80-fce4-44a3-a84e-28b5ca3a9848 service nova] Creating event network-vif-plugged:dc3cad3e-acbe-4108-9aaf-10f03aebdb4f for instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 on hv-cinder-77398 Aug 27 03:31:49.523619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-d009e054-a26b-4242-9cb5-333e874f768f req-ab363f80-fce4-44a3-a84e-28b5ca3a9848 service nova] Creating event network-vif-plugged:212f95d8-459a-4da3-a611-d44a86cc8028 for instance ef870f4c-a749-484d-a466-9be119c21dbf on hv-cinder-77398 Aug 27 03:31:49.533659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-d009e054-a26b-4242-9cb5-333e874f768f req-ab363f80-fce4-44a3-a84e-28b5ca3a9848 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082450 Aug 27 03:31:49.534623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 68/157] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:49.597964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.605688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-12060d3c-b2b6-4073-8880-03e161bf3cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.208852 Aug 27 03:31:49.606296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 90/158] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.699120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.700059 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.706033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.706725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.707511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.707943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.780375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.781520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.789315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.790047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.791637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.792220 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.947928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.957100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c927aef7-beef-4f35-9b9d-74cd52334bd4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.262329 Aug 27 03:31:49.966540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 69/159] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.072407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.080394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9c3ff48e-1319-4555-a217-270af033897f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.305393 Aug 27 03:31:50.089667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 91/160] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:50.622836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.623442 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:50.629702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.630174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.630930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.631355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.753758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.762004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8bc33f27-502d-46c3-a8ff-bc78c3d0a022 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.142768 Aug 27 03:31:50.762637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 70/161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:50 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.974543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.975651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:50.985135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.985699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.986571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.987166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.005920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7b2fbc0-fe1a-4cc3-bc01-97b996647c94"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:51.007006 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.012712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.013161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.013929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.014384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.115930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.123287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-05a7cd3b-fb38-4611-82e0-0a3e427d73f4 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.153960 Aug 27 03:31:51.123864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 92/162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:50 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:51.129426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.129908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.136035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.136477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.137476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.137905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.275541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.283619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-86fa5f29-8154-4ddb-b209-4b2fc2eb6dab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.158787 Aug 27 03:31:51.284308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 93/163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:51 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:51.348376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a2702a-5b9a-4a83-88dc-0afe1a947ef4"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:51.349472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.355305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.355743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.356494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.356917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.378803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7a268d84-c9a6-4fe7-bb4a-399a2d833783 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376422 Aug 27 03:31:51.379419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 71/164] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:51 2021] POST /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:51.551197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-0bdec501-8162-4702-b11f-b5c09cf9ab5b req-3e2d6552-e459-4ce7-9ca0-5a13aff63e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9191928e-b1c1-481f-9776-cca8c77072bb", "name": "network-vif-plugged", "status": "completed", "tag": "1641ee30-e418-421e-8d68-0dc10e0eeba4"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:51.552807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:51.552807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:31:51.561548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-0bdec501-8162-4702-b11f-b5c09cf9ab5b req-3e2d6552-e459-4ce7-9ca0-5a13aff63e9f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.562082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-0bdec501-8162-4702-b11f-b5c09cf9ab5b req-3e2d6552-e459-4ce7-9ca0-5a13aff63e9f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.574051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-0bdec501-8162-4702-b11f-b5c09cf9ab5b req-3e2d6552-e459-4ce7-9ca0-5a13aff63e9f service nova] Creating event network-vif-plugged:1641ee30-e418-421e-8d68-0dc10e0eeba4 for instance 9191928e-b1c1-481f-9776-cca8c77072bb on hv-cinder-77398 Aug 27 03:31:51.579683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-0bdec501-8162-4702-b11f-b5c09cf9ab5b req-3e2d6552-e459-4ce7-9ca0-5a13aff63e9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032563 Aug 27 03:31:51.580279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 72/165] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:51.784824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.785624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.791454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.791904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.792725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.793160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.925049 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.932143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-eea8816e-dfb2-49d2-b124-62e8e0c7fe4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.152285 Aug 27 03:31:51.932709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 73/166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:51 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:52.141128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.141671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.148225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.148665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.149421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.149850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.274896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.282286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e316b961-1049-4c5b-b800-315a01b84d9e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.145107 Aug 27 03:31:52.282851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 74/167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:52.304158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.304762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.310580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.311017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.311793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.312321 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.599603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.606740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4e10cb3b-082b-4c0d-88b9-d56cdca5acd0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.310512 Aug 27 03:31:52.607299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 75/168] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:52.950726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.951333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.958419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.959064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.959823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.960246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.082068 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.089182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-54774388-6183-4c9a-a79f-66d6a2eec6fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.143965 Aug 27 03:31:53.089752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 76/169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:53.298833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.299437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:53.305278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.305716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.306504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.306931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.436493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.444395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ee81135a-e898-4d2c-b5c8-8074fb819ea0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.149382 Aug 27 03:31:53.444958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 77/170] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:53 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:53.623355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.623987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:53.630337 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.630781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.631541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.631971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.757511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.765170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7e4d57fe-2b22-4f19-95ee-78a15d93471e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.145436 Aug 27 03:31:53.766938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 78/171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:53 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:54.106296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.106944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.113166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.113601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.114384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.114808 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.239137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.246827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f8376120-2f2f-436c-a54c-43556faab8c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.144172 Aug 27 03:31:54.247392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 79/172] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:54.460671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.461276 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.467164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.467606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.468959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.469487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.594598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.601814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4733a2d8-0afd-4803-a6ae-99a4f112019e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.144794 Aug 27 03:31:54.602635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 80/173] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:54.783097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.783709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.789416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.789866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.790667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.791098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.911476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.918718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-482971d4-07e0-4f10-a04d-c724ed27aba8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.139387 Aug 27 03:31:54.919278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 81/174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:55.263936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.264596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:55.270922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.271357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.272219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.272653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.395171 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.402286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74527dc4-2156-41f6-b263-ee5ca12d653f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.141922 Aug 27 03:31:55.402787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 82/175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:55 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:55.620279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.621209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:55.628628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.629019 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.629805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.640373 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.643041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d4549838-6f93-4673-99ba-77da93b14ff6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "POST /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.299232 Aug 27 03:31:55.644008 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 94/176] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:51 2021] POST /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976/os-volume_attachments => generated 194 bytes in 4301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:55.817414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.824558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1fdbfffd-d1ca-4353-9567-a633a5efedd3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.209045 Aug 27 03:31:55.825117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 83/177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:55 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:55.935927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.936535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:55.943299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.943736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.944488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.944911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.069966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.077676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2e925df2-88a0-4665-8979-0fd7f66c781f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1321 microversion: 2.1 time: 0.145830 Aug 27 03:31:56.079004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 95/178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:55 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:56.419256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.419875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:56.426311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.426760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.427516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.427948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.552737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.560245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2934cef3-5970-4d91-a068-2e29060b1c09 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1364 microversion: 2.1 time: 0.144573 Aug 27 03:31:56.560816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 84/179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:56 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:56.840985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.841759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:56.848143 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.848582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.849365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.849785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.994755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.002589 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0a050414-5e37-4f35-93f4-0a3f3670b617 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.165248 Aug 27 03:31:57.003184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 96/180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:56 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:57.094857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.095464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.101082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.101525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.102310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.102740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.227445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.239822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-61e5fa0f-af4c-4e6d-9dae-71af8cee7d78 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1515 microversion: 2.1 time: 0.143899 Aug 27 03:31:57.239822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 85/181] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.252666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:57.253747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.259593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.260094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.260909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.261420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.285229 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lazy-loading 'flavor' on Instance uuid ef870f4c-a749-484d-a466-9be119c21dbf {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:31:57.394129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-92f1700f-ccb4-4d31-983d-f9a78aa6e8e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf/action" status: 200 len: 32 microversion: 2.1 time: 0.145973 Aug 27 03:31:57.394925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 97/182] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:57 2021] POST /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:31:57.403374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.403989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.412414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.412856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.413615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.414064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.540058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.548334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ec138359-7ce0-480c-a9ed-8851955443cd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.147433 Aug 27 03:31:57.548581 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 86/183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.579995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.580685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.587355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.587792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.588554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.588979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.714136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.722778 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-14f9fece-a732-41a7-9dcc-e02c60506a63 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1550 microversion: 2.1 time: 0.147920 Aug 27 03:31:57.723353 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 98/184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.739511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.740001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.745683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.746168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.747039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.747650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.831064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-86b13b02-3a6c-487c-9085-49d9604948e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095410 Aug 27 03:31:57.831762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 87/185] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:58.019811 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.020500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:58.026925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.027575 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.028578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.029114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.285502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.296649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ffa39590-30cb-4db8-89fe-4b7624e99cb3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.280857 Aug 27 03:31:58.307229 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 99/186] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:58 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:58.565837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.566508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:58.572427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.572872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.573637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.574092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.967496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.975495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f738bec5-26ef-463d-89c8-a6bd27fea6dd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.414559 Aug 27 03:31:58.976070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 88/187] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:58 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:59.315792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.316499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:59.329439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:59.330531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:59.334378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.336472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.337301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.337735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.343460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.344490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.345480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.345927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.470319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.477658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0bd4c3cd-b096-436c-b27a-a32113b37b8c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.166951 Aug 27 03:31:59.478374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 100/188] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:59 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:59.483027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-b6fef524-177b-4f63-afd0-d078c240e215 req-42b74763-aebb-4306-a056-7f4916ba9b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "356e4fdd-62a5-42e5-bb50-a576d9338e22", "tag": "dc3cad3e-acbe-4108-9aaf-10f03aebdb4f"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:59.484544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:59.484544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:31:59.491438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-b6fef524-177b-4f63-afd0-d078c240e215 req-42b74763-aebb-4306-a056-7f4916ba9b5e service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.491873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-b6fef524-177b-4f63-afd0-d078c240e215 req-42b74763-aebb-4306-a056-7f4916ba9b5e service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.503081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-b6fef524-177b-4f63-afd0-d078c240e215 req-42b74763-aebb-4306-a056-7f4916ba9b5e service nova] Creating event network-changed:dc3cad3e-acbe-4108-9aaf-10f03aebdb4f for instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 on hv-cinder-77398 Aug 27 03:31:59.507830 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-b6fef524-177b-4f63-afd0-d078c240e215 req-42b74763-aebb-4306-a056-7f4916ba9b5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028134 Aug 27 03:31:59.508417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 101/189] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:59.992977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.993679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:59.999765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.000283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.001672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.002136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.129453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:00.137419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-11121106-cb0d-49f1-9dde-24ff02e20181 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.148421 Aug 27 03:32:00.138003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 102/190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:59 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:00.497502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:00.498207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:00.503879 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.504322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.505083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.505638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.633161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:00.644425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c6e92e61-294b-4bfd-a34e-a6d8d57c722e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.150465 Aug 27 03:32:00.645104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 103/191] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:00 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:01.154278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.154556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:01.161164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.161609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.162395 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.162828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.288189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.295426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b090bd0b-15e1-473e-ba47-bab8092171fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.145115 Aug 27 03:32:01.296085 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 104/192] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:01 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:01.661837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.662500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:01.668415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.668858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.669621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.670081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.793261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.801572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1bdee573-af44-4d74-91f1-41127e5a9f7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.143365 Aug 27 03:32:01.802172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 105/193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:01 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:01.986873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-84238e4c-c74e-4085-94b5-3ca16f7a3077 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 2.661840 Aug 27 03:32:01.987610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 89/194] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:59 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:02.312227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.314267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:02.320111 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.320561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.321341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.321779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.623374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.631474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-55ba11a0-c24c-49d6-8da4-ff31f91797d8 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.322846 Aug 27 03:32:02.632063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 106/195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:02 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.819861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.820614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:02.827064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.827508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.828313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.830004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.997484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:02.998579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:03.005279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.005812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.006703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.007137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.165593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cc6d9a80-2699-450a-8181-5cf90a72b88e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 0.171708 Aug 27 03:32:03.166296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 107/196] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:02 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:03.223277 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.230591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6d120e7d-6e16-48d4-a796-0efddc792c02 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1313 microversion: 2.1 time: 0.414916 Aug 27 03:32:03.231155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 90/197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:02 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:03.648483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:03.649193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:03.655450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.655894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.657210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.658204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.802747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.810716 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e4e6390d-4448-4d93-85ce-2738a848a8be tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.165973 Aug 27 03:32:03.811154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 108/198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:03 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:04.177085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:04.178049 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:04.184158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.184594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.185345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.185769 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.248016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.248616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:04.254419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.254912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.255664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.256089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.310536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4b1498e5-17ac-4b59-9bf5-d2b518055494 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 0.136954 Aug 27 03:32:04.314055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 91/199] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:04 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:04.383312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.391367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e9d8c0a9-d804-4585-bd45-8474f50b0c11 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1496 microversion: 2.1 time: 0.146574 Aug 27 03:32:04.391947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 109/200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:04 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1496 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:04.831477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.832163 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:04.838918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.839606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.840450 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.840941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.973868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.982197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-63b3b16e-eb3a-4428-95e4-e7b17362d4a2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.155319 Aug 27 03:32:04.982780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 92/201] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:04 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:05.321241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:05.322892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:05.336595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.337046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.337827 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.338298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.999172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:05.999788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:06.006652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.007134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.007869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.008299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.137042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.144794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-10a884c6-8485-4b80-9067-5d9b1d101550 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.149139 Aug 27 03:32:06.145392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 93/202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:05 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:07.161604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.162348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:07.168104 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.168542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.169291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.169716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.304969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.312255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dcd8bc8a-2bb5-4516-9598-6a82abf7a81f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.154731 Aug 27 03:32:07.313173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 94/203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:07 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:08.329691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.330361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:08.336434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.336868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.337631 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.338053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.465394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.472588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e06e7947-a826-4a00-87b8-dea6081bec8b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.147136 Aug 27 03:32:08.473151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 95/204] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:08 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:09.490242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.490889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:09.496599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.497045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.497818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.498278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.506641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b5534a75-81bc-4aac-8e16-bddf32869567 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 4.188979 Aug 27 03:32:09.507579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 110/205] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:05 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 4191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:09.655794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.663844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7e8621e1-f2d7-469f-82da-04f0854b5ca3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.177282 Aug 27 03:32:09.664415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 96/206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:09 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:10.517609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:10.518641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.525116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.525554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.526338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.526767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.592701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.593220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.599977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.600415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.601170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.601589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.627614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:10.657518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b5d33442-b5ea-48b2-9060-3156ae89a217 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 0.142745 Aug 27 03:32:10.661173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 111/207] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:10 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:10.681212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.682201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.689672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.690151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.690934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.691375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.725811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-69856b77-8bc7-46e9-813e-739599d376a0 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 204 len: 0 microversion: 2.1 time: 0.136167 Aug 27 03:32:10.727278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 97/208] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:10 2021] DELETE /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:32:10.735576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.736345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.742604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.743172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.744157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.744582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.849121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:10.856380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3dab55e5-9511-4806-b079-da71c34ec6dc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.179211 Aug 27 03:32:10.856955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 112/209] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:10 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:10.898991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:10.906906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7d8424f8-3f01-4a40-9f84-834800ccbded tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1502 microversion: 2.1 time: 0.175299 Aug 27 03:32:10.907656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 98/210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:10 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:11.668673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:11.669608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:11.675666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.676104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.677005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.677381 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.796556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5c55f561-c1e5-466e-bdfa-7140db6f37d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 0.131253 Aug 27 03:32:11.797675 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 113/211] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:11 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:11.874265 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.875565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:11.881674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.882151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.882918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.883351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.924640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.925469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:11.932022 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.932463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.933246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.933658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.038184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.048963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5d043705-9b3d-489c-9376-47d02bc4cbe7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.178256 Aug 27 03:32:12.058720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 99/212] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:11 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:12.095799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.103335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ede1ebe6-8395-4ccd-add9-ea55ac92c51b tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1502 microversion: 2.1 time: 0.182861 Aug 27 03:32:12.103904 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 114/213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:11 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:12.807976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:12.808981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:12.815760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.816204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.817009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.817440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.943685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b3254f2d-72c6-452a-b24d-8d64921dbf17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14 microversion: 2.1 time: 0.139226 Aug 27 03:32:12.944391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 100/214] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:12 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:13.069518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.070208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:13.076230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.076672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.077434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.077861 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.123208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.123924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:13.131350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.131797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.132570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.133000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.233863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.242041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fcef0dcf-3f75-4853-ac1d-1fb3cf5f5e51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.180040 Aug 27 03:32:13.242625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 115/215] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:13 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:13.283342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.290676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f7152f5e-f9ea-431e-9a39-a65e0ef3d450 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1502 microversion: 2.1 time: 0.173664 Aug 27 03:32:13.291250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 101/216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:13 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:13.955921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:13.957171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:13.963729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.964910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.965707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.966577 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.160630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bc9e09c0-b62b-4e01-8ad7-dcb18e345659 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 6451 microversion: 2.1 time: 0.208825 Aug 27 03:32:14.161534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 116/217] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:13 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 6451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:14.258551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.259203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:14.265132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.266285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.267108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.267536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.309293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.310953 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:14.319343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.319940 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.320770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.321269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.402004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.415378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fa1a575d-756c-46a9-adb2-a13575e00215 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 200 len: 1460 microversion: 2.1 time: 0.110093 Aug 27 03:32:14.416239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 117/218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:14 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 1460 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:14.421202 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-40d115e4-92b3-4c48-93a3-eb7a6f03ddd0 req-9012d6fe-2ccf-4678-b06b-7d5015caf0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9191928e-b1c1-481f-9776-cca8c77072bb", "name": "network-vif-deleted", "tag": "1641ee30-e418-421e-8d68-0dc10e0eeba4"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:14.423525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:14.423525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:14.431329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-40d115e4-92b3-4c48-93a3-eb7a6f03ddd0 req-9012d6fe-2ccf-4678-b06b-7d5015caf0b9 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.431806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-40d115e4-92b3-4c48-93a3-eb7a6f03ddd0 req-9012d6fe-2ccf-4678-b06b-7d5015caf0b9 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.446159 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-40d115e4-92b3-4c48-93a3-eb7a6f03ddd0 req-9012d6fe-2ccf-4678-b06b-7d5015caf0b9 service nova] Creating event network-vif-deleted:1641ee30-e418-421e-8d68-0dc10e0eeba4 for instance 9191928e-b1c1-481f-9776-cca8c77072bb on hv-cinder-77398 Aug 27 03:32:14.451485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-40d115e4-92b3-4c48-93a3-eb7a6f03ddd0 req-9012d6fe-2ccf-4678-b06b-7d5015caf0b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033867 Aug 27 03:32:14.452090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 118/219] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:14.477484 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.485612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-db51b350-a659-49bd-ba44-f9e2789e1458 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.230750 Aug 27 03:32:14.486258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 102/220] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:14 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.186875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:15.190042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.196894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.197433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.198343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.198879 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.332088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-777217af-cfbd-4af0-a807-b889636acc27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 9596 microversion: 2.1 time: 0.159578 Aug 27 03:32:15.332721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 119/221] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:15 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 9596 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.445126 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.447451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: 9191928e-b1c1-481f-9776-cca8c77072bb] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.470670 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.471117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.474423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.476063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.504411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.505349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.507136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] HTTP exception thrown: Instance 9191928e-b1c1-481f-9776-cca8c77072bb could not be found. Aug 27 03:32:15.507780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Returning 404 to user: Instance 9191928e-b1c1-481f-9776-cca8c77072bb could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:15.509963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6372eaac-d3e7-4bda-a648-e54bcad272c2 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb" status: 404 len: 111 microversion: 2.1 time: 0.080863 Aug 27 03:32:15.514715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 103/222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:15 2021] GET /compute/v2.1/servers/9191928e-b1c1-481f-9776-cca8c77072bb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:15.514878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.534492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.535669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.536189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.669046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1564164651", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "fe7821d0-97cf-441e-beed-217d20735215"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:15.716350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.729523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0bf0f5b2-c8f3-4fd3-aeff-b47980e57585 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.230743 Aug 27 03:32:15.738885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 120/223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:15 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.747498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] validate_networks() for [('fe7821d0-97cf-441e-beed-217d20735215', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:32:16.181282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:16.181800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:16.182532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:16.182987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:16.183400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:16.197078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.197920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.198473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.198979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.217296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Getting quotas for project cda0da7bc3bd48d7b12cbc7e6f823b71. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:16.222299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Getting quotas for user 0002b515bf354a6a83e5cad533c3e292 and project cda0da7bc3bd48d7b12cbc7e6f823b71. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:16.236905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:32:16.239425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:32:16.303454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c819d20c-dd3c-454d-b08d-b94f86a7c736 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638507 Aug 27 03:32:16.304868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 104/224] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:32:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:16.315196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7f62672a-7680-4328-879b-0470a7c671c6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.316581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7f62672a-7680-4328-879b-0470a7c671c6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.354357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:16.356078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.368083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.370706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.373220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.373868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.429865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7f62672a-7680-4328-879b-0470a7c671c6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.437363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7f62672a-7680-4328-879b-0470a7c671c6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1214 microversion: 2.1 time: 0.126549 Aug 27 03:32:16.439935 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 121/225] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:16 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:16.530971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-71b40d0b-f907-4a02-836c-4d63ac721c90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 14402 microversion: 2.1 time: 0.180303 Aug 27 03:32:16.534721 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 105/226] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:16 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 14402 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:16.745883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.746846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.754489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.755297 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.756543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.757134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.908734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.916351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f9aba112-ce8b-4a33-aa5d-45ac2ee04364 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.174225 Aug 27 03:32:16.924600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 122/227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:16 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.456815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.457754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:17.466114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.466569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.467353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.467788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.545557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:17.549112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:17.567735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:17.577650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.579352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.579900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.580339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.588933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-18298256-bef7-43cf-a795-be0bfaa4bda5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1266 microversion: 2.1 time: 0.134936 Aug 27 03:32:17.589576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 106/228] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:17 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.833457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-34209eb9-60e6-4b30-a93d-07eee8cf3886 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 16860 microversion: 2.1 time: 0.295047 Aug 27 03:32:17.834464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 123/229] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:17 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 16860 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:32:17.941942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.942918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:17.955963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.957118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.957922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.958395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.243511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.254454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-46018969-916a-4f49-8aeb-8beda5712095 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.317416 Aug 27 03:32:18.255552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 107/230] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:17 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.606851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.608919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:18.628620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.630606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.632356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.633722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.759762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.768748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ea17e783-aca5-4838-bcb5-c9f307674a6a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1272 microversion: 2.1 time: 0.166396 Aug 27 03:32:18.770102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 124/231] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:18 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.845629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:18.847270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:18.857205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.863174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.864463 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.865156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.906695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-781700265", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "813150a5-dbda-4897-a617-3b0468d8dcc8"}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:18.985759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e8518946-aaf8-4b8a-bd82-2c2541e6a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 17744 microversion: 2.1 time: 0.144637 Aug 27 03:32:18.986433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 108/232] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:18 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 17744 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:18.996586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] validate_networks() for [('813150a5-dbda-4897-a617-3b0468d8dcc8', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:32:19.272107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.272906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:19.282526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:19.285102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.285975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:19.290198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.977688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.989310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-03279ad3-766b-4f89-a831-e1a46ba344b4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.720927 Aug 27 03:32:19.993724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 109/233] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:19 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:19.998615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.999721 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.006500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.007052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.007923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.008594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.074893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:20.075479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:20.076027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:20.076551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:20.077032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:20.092733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.093511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.094796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.095344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.115956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:20.121652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for user 509234c4194142a4b0634c6f08776161 and project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:20.136993 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:32:20.140537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:32:20.197275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7d9421ed-ea03-486b-a2ff-0a87d8a93017 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300102 Aug 27 03:32:20.198443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 125/234] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:32:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:20.205312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:20.206781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.213949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.214837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.216634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.217377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.259775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.273098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cee6415f-dcce-4175-8fa7-837045d57b7a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.275352 Aug 27 03:32:20.273819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 110/235] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:19 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:20.288724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a05db7ad-158c-4268-ae67-67dd8b6cdaea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.289667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a05db7ad-158c-4268-ae67-67dd8b6cdaea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.360522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be4b984a-f04d-4d52-be09-7bb70b53559e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 19342 microversion: 2.1 time: 0.160648 Aug 27 03:32:20.361175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 126/236] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:20 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 19342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:20.413836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a05db7ad-158c-4268-ae67-67dd8b6cdaea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.426103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a05db7ad-158c-4268-ae67-67dd8b6cdaea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1217 microversion: 2.1 time: 0.147684 Aug 27 03:32:20.427460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 111/237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:20 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:20.661257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-3a5533ab-85e8-4d83-ad8b-412c3317f327 req-40932f56-28a8-4082-bc36-2ee0a39b4116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8f2724-6ee8-4f30-989f-a9babebedf04", "tag": "63785667-eab1-4bfd-9104-45e9afa1e6ab"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:20.663048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:20.663048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:20.671388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-3a5533ab-85e8-4d83-ad8b-412c3317f327 req-40932f56-28a8-4082-bc36-2ee0a39b4116 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.672138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-3a5533ab-85e8-4d83-ad8b-412c3317f327 req-40932f56-28a8-4082-bc36-2ee0a39b4116 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.696601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-3a5533ab-85e8-4d83-ad8b-412c3317f327 req-40932f56-28a8-4082-bc36-2ee0a39b4116 service nova] Creating event network-changed:63785667-eab1-4bfd-9104-45e9afa1e6ab for instance bc8f2724-6ee8-4f30-989f-a9babebedf04 on hv-cinder-77398 Aug 27 03:32:20.705438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-3a5533ab-85e8-4d83-ad8b-412c3317f327 req-40932f56-28a8-4082-bc36-2ee0a39b4116 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047942 Aug 27 03:32:20.706328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 127/238] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:21.010120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.010789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.017553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.018313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.019250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.019839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.258095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.268547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2cc67584-c23a-4939-ad0c-b6c71410594b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.262543 Aug 27 03:32:21.281441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 112/239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.292300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.293996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.303008 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.303809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.305027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.305843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.373750 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:21.375748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.382829 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.383335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.395147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.396216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.503688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.514001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-23e5c2b9-049e-4221-9e76-ac83eac17fa7 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.227417 Aug 27 03:32:21.515245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 128/240] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:21.525282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.525282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.530868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.531384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.532494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.532921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.606944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.615488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dc10b168-6d5f-41aa-b290-d3a316af0212 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1269 microversion: 2.1 time: 0.098822 Aug 27 03:32:21.616419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 129/241] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:22.288722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.289280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:22.295200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.295774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.296659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.297189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.433089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.439049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-10794c87-0f09-4824-b796-7f93d7cd5036 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.153529 Aug 27 03:32:22.439877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 130/242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:22 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:22.537979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.538765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:22.549161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.549703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.551503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.551503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.686534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.694736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-519c4831-dcae-452d-af8d-581bca107caf tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.166116 Aug 27 03:32:22.695308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 131/243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:22 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:22.699742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.700352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:22.706798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.707318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.708271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.708769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.776253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.786686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-96b31712-dc96-4f7c-afee-979baeb70db2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1269 microversion: 2.1 time: 0.089805 Aug 27 03:32:22.796008 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 132/244] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:22 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.456537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.457148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:23.463024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.463468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.464264 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.464689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.592697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.600723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aca2be4d-20aa-4d29-99b5-8f5ca788d716 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.148258 Aug 27 03:32:23.601308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 133/245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:23 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:23.712534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.713145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:23.719690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.720129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.720990 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.721593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.858237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.866442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-02d520e9-2503-4b8f-807d-ead2916ea7ac tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.157432 Aug 27 03:32:23.867040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 134/246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:23 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:23.871443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.872053 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:23.878346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.878791 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.879578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.879997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.942202 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.949576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9a08c4bd-52e2-4946-946f-47800df8b78e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1269 microversion: 2.1 time: 0.081555 Aug 27 03:32:23.950258 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 135/247] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:23 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:24.618035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.618663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.625966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.626443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.627227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.627662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.747895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.755888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-18d08a49-6d99-4c78-b6b3-6bdb13a77138 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.141548 Aug 27 03:32:24.756472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 136/248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:24 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:24.883026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.883728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.892386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.892386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.892386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.892386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.012198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.019905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c34a2923-b918-4217-bb4a-4adfdd58c45f tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.140506 Aug 27 03:32:25.020471 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 137/249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:24 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:25.031659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:25.032443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:25.039631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.040151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.041189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.041620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.108522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.116684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e29b3383-5840-47e0-bf3a-ca1acd800f19 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1269 microversion: 2.1 time: 0.090114 Aug 27 03:32:25.117437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 138/250] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:25 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:25.716756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d9798953-cd52-4da9-8431-9b4752f87747 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 24609 microversion: 2.1 time: 4.346476 Aug 27 03:32:25.717433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 113/251] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:21 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 24609 bytes in 4348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:25.772527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:25.773227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:25.779591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.780036 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.781313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.781749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.978459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.986977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-434366c6-e2b7-4a7a-bf50-1a44942bb811 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.218152 Aug 27 03:32:25.987556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 139/252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:25 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:26.038221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.038923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.045939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.046515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.047992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.048428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.144171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.144171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.144171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.144635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.145694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.146525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.244173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.251616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7d1bb7f6-1d29-4fed-beb9-4927e8e25802 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1269 microversion: 2.1 time: 0.120306 Aug 27 03:32:26.252204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 140/253] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:26 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:26.285116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.292601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-41731bed-0921-4762-8af1-5f2df05f347e tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.258315 Aug 27 03:32:26.293181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 114/254] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:26 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:26.729506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:26.730376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.737688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.738168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.738937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.739373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.964591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-49f66399-7e5d-4e0d-a374-b02a01cdb21a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 25634 microversion: 2.1 time: 0.238586 Aug 27 03:32:26.966715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 141/255] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:26 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 25634 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:27.003145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.003759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.014317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.014766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.016080 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.016619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.222047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.229557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-191dbd14-d351-45e0-b4ce-ea26313bf478 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.230259 Aug 27 03:32:27.230158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 115/256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:26 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:27.259305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1114713105", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:27.269952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.270852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.277378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.278161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.279604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.280222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.318460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] validate_networks() for None {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:32:27.405385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.413984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-acc460d4-8c1b-480a-be99-4bd7c47daeb8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1275 microversion: 2.1 time: 0.149224 Aug 27 03:32:27.414587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 116/257] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:27 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:27.428176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.428791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.434695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.435144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.435918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.436349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.806119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.814255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e7dc3501-5932-43f0-92db-64e07c3fb52c tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.398520 Aug 27 03:32:27.815098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 117/258] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:27 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:27.826525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:27.827030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:27.828390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:27.828894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:27.829373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:27.838779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.839602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.840488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.841126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.859287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Getting quotas for project 9bbe5ccf2ba5465c8f6766d2cd8cc275. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:27.863667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Getting quotas for user 5047539ef9fe423183d0fff405c6e422 and project 9bbe5ccf2ba5465c8f6766d2cd8cc275. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:27.876944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:32:27.879455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:32:27.930051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7f3c0d45-8f2d-4820-8ab7-88dd3a24dbc4 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676667 Aug 27 03:32:27.930737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 142/259] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:32:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:27.941369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c6b2f80d-ddf2-498c-9fba-c5c73ec0f1cc tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.941885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c6b2f80d-ddf2-498c-9fba-c5c73ec0f1cc tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.982854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:27.986970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.995165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.996393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.998154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.998864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.090616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c6b2f80d-ddf2-498c-9fba-c5c73ec0f1cc tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.134863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c6b2f80d-ddf2-498c-9fba-c5c73ec0f1cc tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1215 microversion: 2.1 time: 0.196243 Aug 27 03:32:28.138134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 118/260] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:27 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:28.247752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.248668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.253878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0c39fed5-f113-4dbc-862c-bc6aa4599cb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 26381 microversion: 2.1 time: 0.273384 Aug 27 03:32:28.254936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 143/261] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:27 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 26381 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:28.259211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.261250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.262114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.262879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.413101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.414375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.424169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.425034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.425910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.426687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.461323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:28.519853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.527864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-89935873-d3bd-4b14-a551-12f699be057e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.284171 Aug 27 03:32:28.546982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 119/262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:28 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:28.553949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.563409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.578466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.579655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.580810 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.581464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.608338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f75e50e7-505c-4565-b9f8-1b8bba183ec0 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 204 len: 0 microversion: 2.1 time: 0.199318 Aug 27 03:32:28.609423 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 144/263] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:28 2021] DELETE /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:28.623020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.625247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.634774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.635734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.636841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.637474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.048491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.056243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9f7d1981-9a56-4f90-bd16-4c4a2915e6c6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.506724 Aug 27 03:32:29.057091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 120/264] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:28 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.060370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.069402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2fef3fdd-5414-4819-8965-e194768948cf tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1554 microversion: 2.1 time: 0.454361 Aug 27 03:32:29.070343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 145/265] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:28 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1554 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:29.075212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.078338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.084916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.085345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.086174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.086599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.154644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.155270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.162386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.162838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.163607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.164266 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.295712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.305798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-896d1649-965a-47a4-849b-0cd20f64def9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1267 microversion: 2.1 time: 0.153842 Aug 27 03:32:29.307121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 146/266] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:29 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.321233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:29.323263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.329504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.330040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.331124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.331758 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.379850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.388736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4f5540ad-673f-466e-ac38-abe5fb372f8a tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.330392 Aug 27 03:32:29.389331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 121/267] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:29 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.556719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-55d76a4c-9044-4241-8713-2659e5166817 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 26983 microversion: 2.1 time: 0.241318 Aug 27 03:32:29.563564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.564798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.569453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 147/268] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:29 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 26983 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:29.578279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.579202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.580368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.580899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.775658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-4c85bc60-96b7-4029-91af-4cab35b7f770 req-687699d6-189c-4013-93ad-261e98c5aa34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083b799e-ea07-441c-8703-8dc5f55c3c8b", "tag": "e720968b-57f5-4bbf-9203-971f369a9bb6"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:29.782701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:29.782701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:29.801091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-4c85bc60-96b7-4029-91af-4cab35b7f770 req-687699d6-189c-4013-93ad-261e98c5aa34 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.801616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-4c85bc60-96b7-4029-91af-4cab35b7f770 req-687699d6-189c-4013-93ad-261e98c5aa34 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.815180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-4c85bc60-96b7-4029-91af-4cab35b7f770 req-687699d6-189c-4013-93ad-261e98c5aa34 service nova] Creating event network-changed:e720968b-57f5-4bbf-9203-971f369a9bb6 for instance 083b799e-ea07-441c-8703-8dc5f55c3c8b on hv-cinder-77398 Aug 27 03:32:29.820380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-4c85bc60-96b7-4029-91af-4cab35b7f770 req-687699d6-189c-4013-93ad-261e98c5aa34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048987 Aug 27 03:32:29.821339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 148/269] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:29.898676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.906514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-148fce2c-5160-4edc-8be4-1661419788ac tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.364725 Aug 27 03:32:29.916634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 122/270] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:29 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.078738 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.080094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.088591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.089191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.090114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.090719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.091982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.094072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.105516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.105962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.106761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.107215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.487038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.499242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5a87fb10-9640-46dc-8cf9-4ae91dc47c81 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.426873 Aug 27 03:32:30.500046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 149/271] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.505667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.506457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.515045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.516323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.517570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.518393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.521555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.534865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3451287d-7cbc-4c48-abe7-0f78d305bb01 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1554 microversion: 2.1 time: 0.449814 Aug 27 03:32:30.536601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 123/272] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1554 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.556052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.561187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.581365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.582150 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.583198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.583815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.684269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.703667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0664afa7-f282-4fa9-be27-db8950de48cb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1273 microversion: 2.1 time: 0.201844 Aug 27 03:32:30.704218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 150/273] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.717795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:30.719367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.728926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.729370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.730189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.730779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.851929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.860453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b9d82d8d-5b83-46ee-bf9f-0f5ed7c83ed3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.321716 Aug 27 03:32:30.861320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 124/274] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.924658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3240f3c9-133c-4d76-8864-aa234839c419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 27606 microversion: 2.1 time: 0.210084 Aug 27 03:32:30.925892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.927149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.929146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 151/275] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:30 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 27606 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:30.933833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.934587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.935761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.936508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.209157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.217376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fca412c2-15e9-44c8-945a-a30f3e67c702 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.297696 Aug 27 03:32:31.218800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 125/276] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:31.517870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.519823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:31.527436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.528197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.529557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.530372 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.556734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.558162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:31.568227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.569067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.574400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.575064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.242603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.250069 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a9240403-49db-4101-a8c6-fb128d8dc8f3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.736673 Aug 27 03:32:32.262458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 152/277] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:31 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.267847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.268771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.275014 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.275759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.276783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.277453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.352856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.366207 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b91ff1aa-da63-4f42-b3e7-8b4a3bb78d18 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1554 microversion: 2.1 time: 0.814313 Aug 27 03:32:32.376190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 126/278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:31 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1554 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.383022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.383977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.391731 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.392400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.393325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.393914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.553922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.565572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bab010ee-ebbd-4bf6-98f2-8ca4a9e670d0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.301565 Aug 27 03:32:32.567286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 153/279] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.572745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:32.574028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.584637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.586734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.588125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.589173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.667431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.679522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-999a5af3-9929-4aa7-ab2d-61146ca2b539 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.301607 Aug 27 03:32:32.680109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 127/280] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.695309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.695924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.702104 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.702869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.703424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.704059 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.849742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-07845d42-b5f1-4b47-95c4-a918aca26434 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 27836 microversion: 2.1 time: 0.280843 Aug 27 03:32:32.850583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 154/281] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:32 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 27836 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:32.946983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.955543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3015e0a9-6421-41b6-9b88-f712fc4528e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.273972 Aug 27 03:32:32.956595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 128/282] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.037742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-fe384abb-9a67-4210-a247-078556c587be req-6cae498a-a910-42d8-acc4-33863ef884ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef536a-d819-4f5b-b397-f7f0d19dc976", "name": "network-vif-deleted", "tag": "253b001d-b392-41bf-b919-b49c1e9c5699"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:33.040026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:33.040026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:33.049192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-efb3cdf5-c2d5-45cd-9da0-3f7dac3a0692 req-31c52585-3c13-457c-b433-b0e60bb8b1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6beba13a-3440-4c1b-9517-042184caeeb9", "tag": "ef955147-4b79-403d-89a1-3446f8936ab1"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:33.051258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:33.051258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:32:33.062513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-fe384abb-9a67-4210-a247-078556c587be req-6cae498a-a910-42d8-acc4-33863ef884ca service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.064632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-fe384abb-9a67-4210-a247-078556c587be req-6cae498a-a910-42d8-acc4-33863ef884ca service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.066846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-efb3cdf5-c2d5-45cd-9da0-3f7dac3a0692 req-31c52585-3c13-457c-b433-b0e60bb8b1a1 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.069855 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-efb3cdf5-c2d5-45cd-9da0-3f7dac3a0692 req-31c52585-3c13-457c-b433-b0e60bb8b1a1 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.087026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-fe384abb-9a67-4210-a247-078556c587be req-6cae498a-a910-42d8-acc4-33863ef884ca service nova] Creating event network-vif-deleted:253b001d-b392-41bf-b919-b49c1e9c5699 for instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 on hv-cinder-77398 Aug 27 03:32:33.088981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-efb3cdf5-c2d5-45cd-9da0-3f7dac3a0692 req-31c52585-3c13-457c-b433-b0e60bb8b1a1 service nova] Creating event network-changed:ef955147-4b79-403d-89a1-3446f8936ab1 for instance 6beba13a-3440-4c1b-9517-042184caeeb9 on hv-cinder-77398 Aug 27 03:32:33.094082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-fe384abb-9a67-4210-a247-078556c587be req-6cae498a-a910-42d8-acc4-33863ef884ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059700 Aug 27 03:32:33.094396 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-efb3cdf5-c2d5-45cd-9da0-3f7dac3a0692 req-31c52585-3c13-457c-b433-b0e60bb8b1a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049723 Aug 27 03:32:33.095061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 129/283] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:33.095423 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 155/284] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:33.270054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.271368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.294039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.295929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.297032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.297793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.387205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.388516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.405537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.406510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.408511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.409316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.533746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63708acae734472d9c5d4610f54e0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2133a8c527644f82bfc24e5b135d39d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.543176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4c873c06-d06e-490e-b68b-5c95736a2603 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 200 len: 1346 microversion: 2.1 time: 0.161185 Aug 27 03:32:33.544304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 156/285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 1346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.583630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.584304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.593016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.593927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.598673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.599684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.657883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.670201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-851cb3db-8d6c-4df8-b706-0eebddb38ce6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.404431 Aug 27 03:32:33.672560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 130/286] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.696449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.697627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.709002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.709682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.713007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.713755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.014612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.023091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ccbe7fea-4745-4a57-ab69-d0d0d49273e2 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.444304 Aug 27 03:32:34.027902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 157/287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:34.048428 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:34.049354 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.063925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.064541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.065411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.065853 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.104793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.116477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ae06d26a-5e8d-4cec-a91c-2df7db7510cd tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.422301 Aug 27 03:32:34.117930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 131/288] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:34.126005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.127176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.134655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.135329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.136563 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.137132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.304350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9f607a10-0f28-4d15-b0a2-fa1fced57029 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.274957 Aug 27 03:32:34.305013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 158/289] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:34 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:34.311433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.320240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4150e6c4-5f56-4d3f-b5e8-e4cb4403600a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.200676 Aug 27 03:32:34.320833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 132/290] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:34.561536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.563406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.570559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.571284 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.572869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.573614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.592017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] HTTP exception thrown: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. Aug 27 03:32:34.592979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Returning 404 to user: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:34.594911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3b565928-9cf3-4c63-9812-a673ef7361dd tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 404 len: 111 microversion: 2.1 time: 0.037411 Aug 27 03:32:34.608509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 159/291] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:34.690848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.691467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.703997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.703997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.704302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.704743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.758917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.759974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.769120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.770537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.771819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.771819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.795269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] HTTP exception thrown: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. Aug 27 03:32:34.795867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Returning 404 to user: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:34.798594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d0b562f1-f28f-4718-9db1-8706dd4e63c3 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042053 Aug 27 03:32:34.803127 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 160/292] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:35.014251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.027575 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-738529b4-752d-4906-83e0-6c4127a3aa5e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.340407 Aug 27 03:32:35.028326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 133/293] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.045721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.047425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.060559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.060997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.066529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.068736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.134605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.135542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.142623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.143384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.144489 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.145086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.430478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.448052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4910ffe5-2772-4602-b60a-fd0e9d71f838 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.405874 Aug 27 03:32:35.450831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 161/294] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:35 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.469897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:35.471370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.487900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.488641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.490888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.491857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.495111 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.504690 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4f5d89a9-08c5-48fe-b545-99d5ad9d8aef tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.373579 Aug 27 03:32:35.506673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 134/295] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:35 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:35.511993 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.525428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.538299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.541171 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.548578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.549461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.638259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6e516087-cf74-4d91-b9f3-1f9bb87d2eaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.183272 Aug 27 03:32:35.639739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 162/296] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:35 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:35.799915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.813760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-85d16ef0-1023-4922-af17-1551db797120 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.301231 Aug 27 03:32:35.816479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 135/297] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:35 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.045328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.047847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.054697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.055152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.055942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.056359 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.160983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.161659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.169127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.169803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.170972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.171584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.194404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] HTTP exception thrown: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. Aug 27 03:32:36.196082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Returning 404 to user: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:36.197935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3643b595-2910-493a-95df-9798d5cff6c6 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 404 len: 111 microversion: 2.1 time: 0.041457 Aug 27 03:32:36.199125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 136/298] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:36 2021] DELETE /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:32:36.211551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.211950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.213174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] [instance: 4bef536a-d819-4f5b-b397-f7f0d19dc976] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.220142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e66de89b-f554-4496-84a5-62b8947764a4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.178808 Aug 27 03:32:36.230005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.230005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.230005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.230005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.231477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 163/299] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.248125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] HTTP exception thrown: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. Aug 27 03:32:36.248832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] Returning 404 to user: Instance 4bef536a-d819-4f5b-b397-f7f0d19dc976 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:36.250531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8a9670e5-6195-4769-a208-2bbd552b5117 tempest-DeleteServersTestJSON-1046043135 tempest-DeleteServersTestJSON-1046043135-project] 10.222.0.48 "GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976" status: 404 len: 111 microversion: 2.1 time: 0.044472 Aug 27 03:32:36.251596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 137/300] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/4bef536a-d819-4f5b-b397-f7f0d19dc976 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:36.469440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.470652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.492412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.494558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.500081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.501910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.524047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.525280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.537176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.541015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.544648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.547164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.079454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.087934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d9b5df2c-7cf3-4482-9b49-fc1c5b89d3a3 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.568239 Aug 27 03:32:37.088785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 138/301] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.094272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:37.095559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:37.098056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.102475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.103117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.104089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.104659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.106537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b7ddc16a-6ab8-4400-82b4-24db9186bc7a tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.643928 Aug 27 03:32:37.111363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 164/302] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.126900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-031bf234-e34b-420b-a536-ecbbcb945120 req-a67a35b1-c4e6-4db4-ad64-25e90840c30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8f2724-6ee8-4f30-989f-a9babebedf04", "name": "network-vif-plugged", "status": "completed", "tag": "63785667-eab1-4bfd-9104-45e9afa1e6ab"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:37.128460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:37.128460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:37.142479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-031bf234-e34b-420b-a536-ecbbcb945120 req-a67a35b1-c4e6-4db4-ad64-25e90840c30f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.143127 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-031bf234-e34b-420b-a536-ecbbcb945120 req-a67a35b1-c4e6-4db4-ad64-25e90840c30f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.161173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-031bf234-e34b-420b-a536-ecbbcb945120 req-a67a35b1-c4e6-4db4-ad64-25e90840c30f service nova] Creating event network-vif-plugged:63785667-eab1-4bfd-9104-45e9afa1e6ab for instance bc8f2724-6ee8-4f30-989f-a9babebedf04 on hv-cinder-77398 Aug 27 03:32:37.169862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-031bf234-e34b-420b-a536-ecbbcb945120 req-a67a35b1-c4e6-4db4-ad64-25e90840c30f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047577 Aug 27 03:32:37.170865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 165/303] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:37.184915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.185700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:37.204386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.204386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.205177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.205679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.253083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9781adbf-044b-4e29-98c7-99465c464aaa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.160896 Aug 27 03:32:37.258461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 139/304] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:37 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:37.266680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.268187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:37.278301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.279426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.280434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.282349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.585269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.592662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a865d710-170f-43e7-9cb1-0336c1d6868a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.415762 Aug 27 03:32:37.597857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 166/305] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:37 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.672090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.683892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-526c24bb-2bc7-4499-8433-f60b0b456ea8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.420692 Aug 27 03:32:37.684536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 140/306] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:37 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.105359 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.106715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.115310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.116124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.117484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.118349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.129270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.130059 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.141689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.144794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.146537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.151835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.505102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.515597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.524451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2ae5bd73-2918-4f0c-8d61-484582667ecb tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.400607 Aug 27 03:32:38.525047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 141/307] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.528562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1f08782c-43b3-4c38-ad4f-3ac74cfdd381 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1314 microversion: 2.1 time: 0.421102 Aug 27 03:32:38.539765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 167/308] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.545944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:38.547047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.567383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.567832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.568651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.569085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.611337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.611955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.620256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.621335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.622387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.623018 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.720065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-51bdfd5e-d56b-4812-bff4-cff6e386187a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.193655 Aug 27 03:32:38.720922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 142/309] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:38 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:38.728665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.729367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.742174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.742625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.743672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.745567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.077658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.085474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5685a543-a7c2-4b6c-8e41-00f1115690f4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.477877 Aug 27 03:32:39.086319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 168/310] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:39.118446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.126153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-818be645-c0ab-4216-ad98-a8abf3d7fc20 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.403904 Aug 27 03:32:39.126720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 143/311] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.551473 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.552559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.553253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.553813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.572021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.577155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.577349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.577660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.578170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.578639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.578762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.579445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.935529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.947238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-05df7462-48c0-4aaf-b99b-58901e242e0f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.406743 Aug 27 03:32:39.947855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 169/312] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:39 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.956326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:39.957656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.978883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.981773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.984269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.984829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.104184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.112010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-682a938c-2813-4abd-b575-1382885c5a00 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1498 microversion: 2.1 time: 0.568960 Aug 27 03:32:40.123729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 144/313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:39 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1498 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.128062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0315103b-211d-4376-8afc-59923227fb17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.178912 Aug 27 03:32:40.128710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 170/314] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:39 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:40.145818 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.146592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:40.147839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.150552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:40.154956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.155717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.156720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.157175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.164804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.170666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.172189 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.173125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.526149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.538985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-19895407-b9e5-476b-bd91-7f047e46565f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.398988 Aug 27 03:32:40.539680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 171/315] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:40 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.542329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.561092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f7150ea1-9705-4696-94ff-3614e5300e96 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.425036 Aug 27 03:32:40.561697 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 145/316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:40 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.629814 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-bf45e1ee-1d10-458b-a9a9-483cb80cdba5 req-af0a459e-8605-4568-8a66-90b47ac2793e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083b799e-ea07-441c-8703-8dc5f55c3c8b", "name": "network-vif-plugged", "status": "completed", "tag": "e720968b-57f5-4bbf-9203-971f369a9bb6"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:40.631455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:40.631455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:40.638567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-bf45e1ee-1d10-458b-a9a9-483cb80cdba5 req-af0a459e-8605-4568-8a66-90b47ac2793e service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.639324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-bf45e1ee-1d10-458b-a9a9-483cb80cdba5 req-af0a459e-8605-4568-8a66-90b47ac2793e service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.651979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-bf45e1ee-1d10-458b-a9a9-483cb80cdba5 req-af0a459e-8605-4568-8a66-90b47ac2793e service nova] Creating event network-vif-plugged:e720968b-57f5-4bbf-9203-971f369a9bb6 for instance 083b799e-ea07-441c-8703-8dc5f55c3c8b on hv-cinder-77398 Aug 27 03:32:40.658158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-bf45e1ee-1d10-458b-a9a9-483cb80cdba5 req-af0a459e-8605-4568-8a66-90b47ac2793e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031936 Aug 27 03:32:40.658763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 172/317] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:40.964706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.965587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:40.974326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.975090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.975544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.976217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.141187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:41.142684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.161044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.161931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.163171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.164000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.257416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.265643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c16ac88e-9046-4ed8-8289-f3dc9c619421 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.303930 Aug 27 03:32:41.269461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 146/318] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:40 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.563930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.564613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.579732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.582456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.583513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.583845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.659128 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5da0b4bf-08bd-4ef1-a22e-9624dfb4fce1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.521739 Aug 27 03:32:41.660450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 173/319] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:41 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:32:41.677188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.677978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.686642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.688812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.689798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.690493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.901329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.909736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0437a73a-6e9e-42fd-9f1f-53afc7d19e48 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.354497 Aug 27 03:32:41.913525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 147/320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:41 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.918904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.922554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.946124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.946720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.947655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.948083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.974999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.987317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:41.987680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-212fff96-2a81-4df2-84a0-1624b0cff36f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.325466 Aug 27 03:32:41.994061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 174/321] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:41 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:42.164746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fe294dbe-7f0f-424f-9749-2b9179bda670 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 204 len: 0 microversion: 2.1 time: 0.249161 Aug 27 03:32:42.166392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 148/322] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:41 2021] DELETE /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:42.184679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.186689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.204302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.205156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.206339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.215083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.285966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.286989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.297503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.299053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.300694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.301323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.541096 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.550683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-397914ee-9c87-46e5-9d14-19fb05896be5 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1504 microversion: 2.1 time: 0.377406 Aug 27 03:32:42.561768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 175/323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:42 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:42.634305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.649758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3160e19d-11f6-4b11-ad15-422f61d25311 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.366302 Aug 27 03:32:42.650678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 149/324] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:42 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:42.674513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:42.675434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.684616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.685062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.685846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.686355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.889641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-382ee806-930a-493f-8f6b-a9c7d271814f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.221392 Aug 27 03:32:42.890698 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 176/325] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:42 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:42.931091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.932025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.941589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.942455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.943793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.944533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.007739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.008781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:43.024559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.026946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.029306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.030325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.239078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.253689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f1cfc43a-c87b-48e3-a377-17fe85933edb tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1317 microversion: 2.1 time: 0.327604 Aug 27 03:32:43.255267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 150/326] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:42 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.349328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-150e30b9-b7f0-465f-ac21-1c2818781a5b req-fe66c98c-a088-4c3f-907a-069e37e37158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beba13a-3440-4c1b-9517-042184caeeb9", "name": "network-vif-plugged", "status": "completed", "tag": "ef955147-4b79-403d-89a1-3446f8936ab1"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:43.353046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:43.353046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:32:43.366296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-150e30b9-b7f0-465f-ac21-1c2818781a5b req-fe66c98c-a088-4c3f-907a-069e37e37158 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.366962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-150e30b9-b7f0-465f-ac21-1c2818781a5b req-fe66c98c-a088-4c3f-907a-069e37e37158 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.386346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-150e30b9-b7f0-465f-ac21-1c2818781a5b req-fe66c98c-a088-4c3f-907a-069e37e37158 service nova] Creating event network-vif-plugged:ef955147-4b79-403d-89a1-3446f8936ab1 for instance 6beba13a-3440-4c1b-9517-042184caeeb9 on hv-cinder-77398 Aug 27 03:32:43.399117 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.400442 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-150e30b9-b7f0-465f-ac21-1c2818781a5b req-fe66c98c-a088-4c3f-907a-069e37e37158 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057210 Aug 27 03:32:43.403997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 151/327] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:43.409054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f476ac62-fa25-473c-8d6a-4228cbf241fb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.406049 Aug 27 03:32:43.412055 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 177/328] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:43 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.571086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.571785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:43.584340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.584785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.592889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.593638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.667535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.668430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:43.682934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.683617 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.684168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.684584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.404828 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.415912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8d880e0a-c52f-464d-b3cf-956ea748d0fc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1504 microversion: 2.1 time: 0.850858 Aug 27 03:32:44.419589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 152/329] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:43 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1504 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.438908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:44.440282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.454405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.461538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.463096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.464029 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.526851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.535286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bcc44f32-0f43-46b2-85f5-95fc31cd94f9 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.871412 Aug 27 03:32:44.539987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 178/330] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:43 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:44.549807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.553290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.567576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.568410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.569432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.570002 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.935994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d80be983-5aef-488b-ab36-8c3451646a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.514104 Aug 27 03:32:44.936644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 153/331] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:44 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:44.953060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.954234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.967285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.970337 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.972518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.973157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.663044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.673828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-640d43a7-b28c-4798-a0ca-8e7a6aac15ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1508 microversion: 2.1 time: 1.132263 Aug 27 03:32:45.697021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 179/332] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:44 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1508 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.714450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.716777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:45.737678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.739180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.748466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.751567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.856925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.871184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-78ea9e11-55c0-4bb0-8693-dca071169968 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1521 microversion: 2.1 time: 0.928241 Aug 27 03:32:45.880804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 154/333] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:44 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1521 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.894694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.896411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:45.922390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.922834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.923627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.924055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.504607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.544597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee824833-8ad8-4a01-bf63-1e46b67913e6 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1504 microversion: 2.1 time: 0.845736 Aug 27 03:32:46.566877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 180/334] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:45 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1504 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.588865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7b2fbc0-fe1a-4cc3-bc01-97b996647c94"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:46.596420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.607855 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.610650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.611104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.617595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-761cdf14-477d-4822-8c74-25d7b01a61b1 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1315 microversion: 2.1 time: 0.734954 Aug 27 03:32:46.617959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.618462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.619388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 155/335] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:45 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.624478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:46.625944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.633286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.634264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.635208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.635793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.790071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f565f309-0acd-4c8d-93ec-87d2579c544b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.169026 Aug 27 03:32:46.791350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 156/336] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:46 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:46.804506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] HTTP exception thrown: Invalid volume: volume c7b2fbc0-fe1a-4cc3-bc01-97b996647c94 is already attached to instances: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f Aug 27 03:32:46.805115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Returning 400 to user: Invalid volume: volume c7b2fbc0-fe1a-4cc3-bc01-97b996647c94 is already attached to instances: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:46.820087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-711affc8-efbe-4f13-a456-c5f3f4a568ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.238070 Aug 27 03:32:46.824183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 181/337] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:32:46 2021] POST /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b/os-volume_attachments => generated 174 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:32:46.897473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.898327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.915890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.917718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.923524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.926857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.962239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.966237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.975006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.975986 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.976856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.977359 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.278051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'services' on Instance uuid 2b8d878f-cb25-4cd8-b690-81e8698f2a1f {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:47.493757 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f07937dd-4c0a-4eea-b5cc-a009c6f39044 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments/c7b2fbc0-fe1a-4cc3-bc01-97b996647c94" status: 202 len: 0 microversion: 2.1 time: 0.538416 Aug 27 03:32:47.497445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 182/338] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:32:46 2021] DELETE /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments/c7b2fbc0-fe1a-4cc3-bc01-97b996647c94 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:47.497584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.505775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d9169c8-d755-47ed-bd10-59689757ccc0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1501 microversion: 2.1 time: 0.612707 Aug 27 03:32:47.506118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-cf4e3f59-0695-459d-b2b4-206b70b28532 req-f1363ff6-1151-40d4-ad6d-a64a981b48ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8f2724-6ee8-4f30-989f-a9babebedf04", "name": "network-vif-deleted", "tag": "63785667-eab1-4bfd-9104-45e9afa1e6ab"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:47.506388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 157/339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:46 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1501 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.521139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:47.521139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:47.526126 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.526995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:47.538897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-cf4e3f59-0695-459d-b2b4-206b70b28532 req-f1363ff6-1151-40d4-ad6d-a64a981b48ee service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.542035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-cf4e3f59-0695-459d-b2b4-206b70b28532 req-f1363ff6-1151-40d4-ad6d-a64a981b48ee service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.559358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.560618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.563927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.566503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.569531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-cf4e3f59-0695-459d-b2b4-206b70b28532 req-f1363ff6-1151-40d4-ad6d-a64a981b48ee service nova] Creating event network-vif-deleted:63785667-eab1-4bfd-9104-45e9afa1e6ab for instance bc8f2724-6ee8-4f30-989f-a9babebedf04 on hv-cinder-77398 Aug 27 03:32:47.589085 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-cf4e3f59-0695-459d-b2b4-206b70b28532 req-f1363ff6-1151-40d4-ad6d-a64a981b48ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092718 Aug 27 03:32:47.590366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 183/340] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:47.595843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.596771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:47.610045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.617094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.619279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.621154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.676227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ce9e370e-6de4-460c-9a8a-2b028b50e508 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160695 Aug 27 03:32:47.676625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 158/341] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:47 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:47.685180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.694618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:47.701053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.701738 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.704234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.706543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.784352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.784902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.785556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lazy-loading 'fault' on Instance uuid bc8f2724-6ee8-4f30-989f-a9babebedf04 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:47.899670 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002b515bf354a6a83e5cad533c3e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0da7bc3bd48d7b12cbc7e6f823b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.911009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9f6b82db-66d1-4e81-bfd5-13a02cec28a8 tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 200 len: 1304 microversion: 2.1 time: 0.233180 Aug 27 03:32:47.911965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 159/342] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:47 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.922645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.925376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:47.961226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.961673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.962493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.969775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.213863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.227149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-20803857-a5ce-4388-ac83-8ab34c67d81c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1516 microversion: 2.1 time: 0.635204 Aug 27 03:32:48.228246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 184/343] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:47 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1516 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.248708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:48.250453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.259488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.259932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.266082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.266653 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.398777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-57a4ea71-91ef-43a0-b645-724dd732259d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.168118 Aug 27 03:32:48.404703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 185/344] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:48 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:48.675423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.688841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bc611498-c194-4c76-be41-505a8ed20a9e tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1464 microversion: 2.1 time: 0.775414 Aug 27 03:32:48.691939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 160/345] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:47 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1464 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.692867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.694088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.706191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.706932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.708525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.709767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.773268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7d2ef2d4-5e78-4bf6-9376-3a2b44195aba tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088954 Aug 27 03:32:48.773661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 186/346] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:48 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:48.929443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.930114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] [instance: bc8f2724-6ee8-4f30-989f-a9babebedf04] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.944939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.945741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.954003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.960942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.989306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.990335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.007813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.009001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.009851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.029563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.037956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] HTTP exception thrown: Instance bc8f2724-6ee8-4f30-989f-a9babebedf04 could not be found. Aug 27 03:32:49.038615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] Returning 404 to user: Instance bc8f2724-6ee8-4f30-989f-a9babebedf04 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:49.039487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c7bb117e-a577-490a-a4ad-e25b37de35dc tempest-VolumesActionsTest-2001099602 tempest-VolumesActionsTest-2001099602-project] 10.222.0.48 "GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04" status: 404 len: 111 microversion: 2.1 time: 0.115032 Aug 27 03:32:49.040048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 161/347] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:48 2021] GET /compute/v2.1/servers/bc8f2724-6ee8-4f30-989f-a9babebedf04 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:49.152212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:49.392129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-610eee2f-b211-484a-a93c-208c1f74ab7f tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 204 len: 0 microversion: 2.1 time: 0.408046 Aug 27 03:32:49.393884 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 187/348] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:48 2021] DELETE /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:32:49.403414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.404039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.414521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:49.416932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.420406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.423411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.424418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.425017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.435729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.442669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.444187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.446367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.614413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d3e4dfd2-4ae5-4bf3-a10a-70b22829201f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.205155 Aug 27 03:32:49.619648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 188/349] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:49 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:32:49.786411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.789208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.810144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.810591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.811389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.811850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.935969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-611364cc-cec6-4ddc-a07d-d8c1e4178323 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151980 Aug 27 03:32:49.945024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 189/350] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:49 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:50.033002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.044271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-326a0834-4f7d-4ccc-a204-ec322c5a33e0 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1470 microversion: 2.1 time: 0.642139 Aug 27 03:32:50.045707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 162/351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:49 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:50.367548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1869012401", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "813150a5-dbda-4897-a617-3b0468d8dcc8"}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:50.460034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] validate_networks() for [('813150a5-dbda-4897-a617-3b0468d8dcc8', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:32:50.574193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:50.575447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:50.582505 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.583225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.584204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.584850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.615206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lazy-loading 'flavor' on Instance uuid 248b6ca4-52d6-42f2-8ab8-823ee2872a2c {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:50.799627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9834d041-a0c1-430e-9e4b-3b0873aa22a1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action" status: 200 len: 32 microversion: 2.1 time: 0.229311 Aug 27 03:32:50.804797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 163/352] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:50 2021] POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:32:50.811202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:50.815550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:50.828793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.829524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.830549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.835428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.037749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9544b20a-6f7e-47b7-868e-aeff5b00fbca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28145 microversion: 2.1 time: 0.231135 Aug 27 03:32:51.038812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 164/353] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:50 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28145 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:51.044549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.045245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:51.083657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.084767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.085635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.090733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.981577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.992296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-69ccb0ce-11e7-4134-b9d5-e98911cc4525 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.952280 Aug 27 03:32:51.993438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 165/354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:51 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.010394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.018109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:52.044092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.045241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.046615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.047595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.657796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:52.668500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-948e7051-6d71-4942-89ea-9bcdf434eb8b tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1470 microversion: 2.1 time: 0.659721 Aug 27 03:32:52.683553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 166/355] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:52 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1470 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.695500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:52.698973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:52.707585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.708291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.709234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.710301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.845536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:52.847237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:52.847941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:52.848911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:52.849580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:52.860622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.861420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.862494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.863229 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.882469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:52.886983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for user 509234c4194142a4b0634c6f08776161 and project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:52.909900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:32:52.912748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:32:52.984686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-937f4cf2-c431-40fc-8958-4f5a2f7d158c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.620948 Aug 27 03:32:52.993321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 190/356] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:32:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 2631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:53.221448 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6fa1a108-86b2-4f25-aff7-77a4e13fec57 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'create', calling method: .version_select at 0x7fb1309b5af0>, body: {"keypair": {"name": "tempest-keypair-186912971"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:53.253098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-6fa1a108-86b2-4f25-aff7-77a4e13fec57 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:53.258958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-6fa1a108-86b2-4f25-aff7-77a4e13fec57 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for user 2e0333e9dafb463c89094944cbba7689 and project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:53.546626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-6fa1a108-86b2-4f25-aff7-77a4e13fec57 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:53.558286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-6fa1a108-86b2-4f25-aff7-77a4e13fec57 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for user 2e0333e9dafb463c89094944cbba7689 and project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:53.577013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6fa1a108-86b2-4f25-aff7-77a4e13fec57 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.582103 Aug 27 03:32:53.579646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 191/357] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Aug 27 03:32:52 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 586 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:32:53.607497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5577d3d0-65ae-422e-a42b-200b9cbf19fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.609248 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5577d3d0-65ae-422e-a42b-200b9cbf19fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:53.746154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5577d3d0-65ae-422e-a42b-200b9cbf19fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.760144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5577d3d0-65ae-422e-a42b-200b9cbf19fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1218 microversion: 2.1 time: 0.177665 Aug 27 03:32:53.766886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 192/358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:53 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.775995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.778227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:53.798301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:53.800293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:53.801269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:53.803084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.047107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.068992 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4b4bbbec-714b-4aad-b203-78c46f35ad94 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.298584 Aug 27 03:32:54.069795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 193/359] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:53 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.125943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.130963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:54.150254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.151903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.156063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.156529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.399086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.407384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f4ea3e4b-2510-45a5-a76c-4c214a693cfa tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1470 microversion: 2.1 time: 0.316589 Aug 27 03:32:54.417538 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 194/360] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:54 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.787987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.788752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:54.814833 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.815331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.817551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.818252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.987355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.998542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-92aba04d-6f83-4224-899b-35284f44f6aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1222 microversion: 2.1 time: 0.216425 Aug 27 03:32:55.010815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 195/361] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:54 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:55.090415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.091271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:55.099943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.102971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.112928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.113561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.489954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.498229 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9cf05528-72c1-4bce-9850-0fbdeb8b06ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.415101 Aug 27 03:32:55.502756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 196/362] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:55 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:55.508701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-723b7bef-38fe-4037-b95c-581fd10a7e18 req-892061fd-bc9a-46f2-9bae-60f036e2946f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beba13a-3440-4c1b-9517-042184caeeb9", "name": "network-vif-deleted", "tag": "ef955147-4b79-403d-89a1-3446f8936ab1"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:55.522155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:55.522155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:32:55.531441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-723b7bef-38fe-4037-b95c-581fd10a7e18 req-892061fd-bc9a-46f2-9bae-60f036e2946f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.532119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-723b7bef-38fe-4037-b95c-581fd10a7e18 req-892061fd-bc9a-46f2-9bae-60f036e2946f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.545057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-723b7bef-38fe-4037-b95c-581fd10a7e18 req-892061fd-bc9a-46f2-9bae-60f036e2946f service nova] Creating event network-vif-deleted:ef955147-4b79-403d-89a1-3446f8936ab1 for instance 6beba13a-3440-4c1b-9517-042184caeeb9 on hv-cinder-77398 Aug 27 03:32:55.552078 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-723b7bef-38fe-4037-b95c-581fd10a7e18 req-892061fd-bc9a-46f2-9bae-60f036e2946f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047643 Aug 27 03:32:55.552986 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 197/363] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:55.561313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.562455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:55.578166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.580114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.581385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.582255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.674961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.684973 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9398f11a-8920-45c7-b7ee-6456e1df83f7 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1428 microversion: 2.1 time: 0.130537 Aug 27 03:32:55.686123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 198/364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:55 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:55.883818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-76daafe3-2931-4833-8025-66ecd9625329 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28436 microversion: 2.1 time: 3.198277 Aug 27 03:32:55.887840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 167/365] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:52 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28436 bytes in 3201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:56.019930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.021226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.037656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.049335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.051443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.051655 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.229825 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.241941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f86d4425-3d67-44ac-b3e9-63ec05bea33a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1214 microversion: 2.1 time: 0.226964 Aug 27 03:32:56.242352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 199/366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:56 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.521144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.522204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.539066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.539784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.541118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.541700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.704353 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.705332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.718457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.719065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.721490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.734652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.805839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.809431 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.810208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lazy-loading 'fault' on Instance uuid 6beba13a-3440-4c1b-9517-042184caeeb9 {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:56.910968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5047539ef9fe423183d0fff405c6e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bbe5ccf2ba5465c8f6766d2cd8cc275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.926555 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eac5eaf2-81d0-4c30-a035-2edf801ef890 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 200 len: 1305 microversion: 2.1 time: 0.226755 Aug 27 03:32:56.927651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 200/367] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:56 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 1305 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:56.933822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:56.935030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.943468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.944328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.945328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.945907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.985993 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.994663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-92e57de9-fc15-408a-9bec-202fc398ac5b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.478906 Aug 27 03:32:56.996474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 168/368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:56 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.002755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1687083926", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff1f034d-3826-4da6-8a6a-7416252fe801"}], "security_groups": [{"name": "tempest-securitygroup--732909302"}], "key_name": "tempest-keypair-186912971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:57.127016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bd9ceb93-0fea-4b70-b3d0-27a84d89f9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28538 microversion: 2.1 time: 0.197765 Aug 27 03:32:57.131457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 201/369] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:56 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28538 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:57.133887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] validate_networks() for [('ff1f034d-3826-4da6-8a6a-7416252fe801', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:32:57.259922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.261300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:57.275473 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.275925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.276713 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.277149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.455355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.468650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2a6cc8f0-b4f6-4e23-acc5-b8543343089a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1276 microversion: 2.1 time: 0.211552 Aug 27 03:32:57.481160 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 202/370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:57 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:57.946951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.948237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] [instance: 6beba13a-3440-4c1b-9517-042184caeeb9] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:57.958676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.960525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.963728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.966886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.013800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] HTTP exception thrown: Instance 6beba13a-3440-4c1b-9517-042184caeeb9 could not be found. Aug 27 03:32:58.022943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] Returning 404 to user: Instance 6beba13a-3440-4c1b-9517-042184caeeb9 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:58.024051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-beebec4f-3606-4825-aaf2-4b537d826b52 tempest-VolumesNegativeTest-994710055 tempest-VolumesNegativeTest-994710055-project] 10.222.0.48 "GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9" status: 404 len: 111 microversion: 2.1 time: 0.083181 Aug 27 03:32:58.036627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 203/371] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:57 2021] GET /compute/v2.1/servers/6beba13a-3440-4c1b-9517-042184caeeb9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:58.053947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.055391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:58.078617 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.086655 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.090430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.091041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.477296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:58.477865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:58.480056 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:58.480688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:58.481119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:58.501293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.520224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6dff227e-6370-4990-b2af-4331d0e017ce tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.481750 Aug 27 03:32:58.521594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 204/372] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:58 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:58.532884 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:58.537391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:58.544865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.545730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.547147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.547960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.563464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.567368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.579996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.580780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.657355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:32:58.667060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for user 2e0333e9dafb463c89094944cbba7689 and project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:32:58.681875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:32:58.684555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:32:58.707250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a87a238d-e0e4-4c67-a660-45a650d5123b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28909 microversion: 2.1 time: 0.183835 Aug 27 03:32:58.708524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 205/373] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:58 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28909 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:58.717374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.721319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:58.738892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.739982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.742310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.743942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.801026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fbb691ca-856b-4734-87d8-83408673c1a2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.803179 Aug 27 03:32:58.808126 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 169/374] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Aug 27 03:32:56 2021] POST /compute/v2.1/servers => generated 401 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:32:58.818857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fd52e46c-cb1b-43d9-a1a3-419ff8e715d7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.819852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fd52e46c-cb1b-43d9-a1a3-419ff8e715d7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:58.996336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fd52e46c-cb1b-43d9-a1a3-419ff8e715d7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.005801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fd52e46c-cb1b-43d9-a1a3-419ff8e715d7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.011651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fd52e46c-cb1b-43d9-a1a3-419ff8e715d7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.018919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fd52e46c-cb1b-43d9-a1a3-419ff8e715d7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1281 microversion: 2.20 time: 0.209281 Aug 27 03:32:59.021273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 170/375] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:58 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:59.134325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.144702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a9c7e532-08cd-407d-a5dd-cc3b4b2137d8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.434633 Aug 27 03:32:59.150249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 206/376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:58 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:59.544504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.545160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:59.562721 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:59.565007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.566482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:59.572134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.720823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:59.732809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:59.766602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:59.768639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.771684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:59.775410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.966794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.990548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-374dceaf-bf53-4c47-ae40-c32423995538 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.454498 Aug 27 03:32:59.996037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 171/377] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:59 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:00.015133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5302f6b4-df12-43b5-bca3-df1182392f91 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.298529 Aug 27 03:33:00.016513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 207/378] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:59 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:00.040565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.041178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:00.057105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.057799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.061004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.061602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.167279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.168264 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:00.181346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.186080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.189043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.193222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.226444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.235763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.240973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.248279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-acbdb033-8d1d-4076-af36-b13351122dc5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1277 microversion: 2.20 time: 0.211362 Aug 27 03:33:00.252046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 172/379] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:00 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:33:00.757385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-effa727f-09cc-4ba1-a7c5-a5f31581da4d req-e28bd125-7189-4334-8dc7-efc98e470531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bcfa74-f228-4e6c-842b-66a5cad93c7a", "tag": "e8511243-ef8e-4d2c-a8e0-aa94a2ff41d1"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:00.759159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:00.759159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:00.778652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-effa727f-09cc-4ba1-a7c5-a5f31581da4d req-e28bd125-7189-4334-8dc7-efc98e470531 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.779114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-effa727f-09cc-4ba1-a7c5-a5f31581da4d req-e28bd125-7189-4334-8dc7-efc98e470531 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.820565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-effa727f-09cc-4ba1-a7c5-a5f31581da4d req-e28bd125-7189-4334-8dc7-efc98e470531 service nova] Creating event network-changed:e8511243-ef8e-4d2c-a8e0-aa94a2ff41d1 for instance f8bcfa74-f228-4e6c-842b-66a5cad93c7a on hv-cinder-77398 Aug 27 03:33:00.831846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-effa727f-09cc-4ba1-a7c5-a5f31581da4d req-e28bd125-7189-4334-8dc7-efc98e470531 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078209 Aug 27 03:33:00.835688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 173/380] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:00.874402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.882866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2e3c32ed-9883-46df-b353-2cf41b0ac2d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.719680 Aug 27 03:33:00.889106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 208/381] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:00 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:01.012265 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.013339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.024099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.024950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.025963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.029043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:01.029965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.031849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.047081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.047441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.048325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.064167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.234916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e6600b5a-0f16-4df9-9da5-066c6aa6c79c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.210400 Aug 27 03:33:01.236064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 209/382] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:01 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:01.275304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.277671 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.286769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.287556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.288539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.289120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.450626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.477863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.479883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.481763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-905e52f7-8049-44e0-817e-c3697cead281 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1339 microversion: 2.20 time: 0.212634 Aug 27 03:33:01.482355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 210/383] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1339 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:01.909674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.910390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.926197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.928297 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.930598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.931696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.973138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.982544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6d4e332b-3ec9-44dd-919a-0d560c1dddba tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.974122 Aug 27 03:33:01.983139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 174/384] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.247287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:02.248364 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:02.262007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.262768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.263885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.264988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.324669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.336507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-537c0b2f-2ba8-4a3c-99ea-ea4a7eb7b05e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.431384 Aug 27 03:33:02.337566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 211/385] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.418091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0f82aa65-8c57-45e2-b0c8-2ab43482739b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.174239 Aug 27 03:33:02.419491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 175/386] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:02 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:02.501670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.502483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:02.518095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.518921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.519928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.520572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.757749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.775527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.782218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.786393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-54e80329-be58-4b95-a164-d2e015f9c4b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1339 microversion: 2.20 time: 0.289042 Aug 27 03:33:02.798177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 212/387] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:02 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:03.000429 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.005966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:03.041734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.055377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.056368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.066280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.368300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.370828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:03.420635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.425817 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.427356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.428027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.867508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.883669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a6486eb7-ed74-47fd-bebf-63ca50beaa90 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.886397 Aug 27 03:33:03.885668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 176/388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:02 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.910623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:03.913147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:03.931896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.932868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.938901 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.939683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.946531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.966290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee3342d7-fc45-426f-b5eb-48e3a820881a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.615768 Aug 27 03:33:03.966896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 213/389] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:03 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.973090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.986381 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:03.993480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.994572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.996234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.997862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.093971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-16a4e254-32c3-4705-893a-c0d2790b38b4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.197512 Aug 27 03:33:04.095866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 177/390] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:03 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:04.404614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.417014 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.418569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.423227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1a321e59-3e03-4951-a436-da9491e007ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.454320 Aug 27 03:33:04.423821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 214/391] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:03 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:04.902133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.903116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:04.931214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.931977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.933230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.938895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.984876 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.985803 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:04.996436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.005265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.008410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.012442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.435996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.452699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-848fa024-a2c8-41bf-94d8-03624bd84110 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.468405 Aug 27 03:33:05.454454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 215/392] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:04 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:05.474922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:05.478283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:05.496255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.497491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.501417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.502307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.577510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.586824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6215353a-1956-4c07-becc-9c10c3f5a472 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.689597 Aug 27 03:33:05.593339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 178/393] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:04 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.600882 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-88c8765e-4bc6-4b07-9dd6-60568ee94a44 req-5cb3c6e7-6026-46ec-b9ec-f92ce0e60dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:05.608488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:05.608488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:05.629571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-88c8765e-4bc6-4b07-9dd6-60568ee94a44 req-5cb3c6e7-6026-46ec-b9ec-f92ce0e60dc4 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.630325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-88c8765e-4bc6-4b07-9dd6-60568ee94a44 req-5cb3c6e7-6026-46ec-b9ec-f92ce0e60dc4 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.645916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e82b07ad-b08f-4f50-a9e5-d5b20d88138f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.185681 Aug 27 03:33:05.651400 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 216/394] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:05 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:05.658960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.660037 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:05.667318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-88c8765e-4bc6-4b07-9dd6-60568ee94a44 req-5cb3c6e7-6026-46ec-b9ec-f92ce0e60dc4 service nova] Creating event network-changed:4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8 for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 on hv-cinder-77398 Aug 27 03:33:05.670869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.671905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.673118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.673789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.692753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-88c8765e-4bc6-4b07-9dd6-60568ee94a44 req-5cb3c6e7-6026-46ec-b9ec-f92ce0e60dc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095796 Aug 27 03:33:05.693630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 179/395] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:06.035945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.047748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.049307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.054912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dd7288f8-5f82-4e76-9c0b-abdd980fb105 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.401216 Aug 27 03:33:06.066476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 217/396] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:05 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:06.481121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.482064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:06.508507 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.509180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.510486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.511487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.609177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.609809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:06.628331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.629043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.630084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.630726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.831228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.884763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-918fc550-c50d-404a-8561-b7dd311f95de tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.410033 Aug 27 03:33:06.895774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 180/397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:06 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:06.930085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:06.931765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:06.955496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.956884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.958654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.959445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.336906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7e7e8a95-ccee-41e5-bb5c-0440099a3d28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.438835 Aug 27 03:33:07.338813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 181/398] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:06 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:07.348991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.349918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:07.375895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:07.377857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.382191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:07.383690 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.458274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.468214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7428f7c8-4d88-433b-b95f-67bd6dd3e049 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.862659 Aug 27 03:33:07.474832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 218/399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:06 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:07.697134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.711251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.716715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.718644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-21de9929-d5ee-4cda-9a93-9f91d137aa6c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.378566 Aug 27 03:33:07.727013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 182/400] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:07 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:07.903766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.905205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:07.913744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:07.914963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.917591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:07.918470 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.122998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a24d09e1-a5ef-4ee1-9cf0-ba5957a1ee4f tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Action: 'create', calling method: .version_select at 0x7fb1311f4a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-56621486"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:08.165786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-a24d09e1-a5ef-4ee1-9cf0-ba5957a1ee4f tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Getting quotas for project f04c0694a50c4533859c8db8a7269b63. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:08.170157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-a24d09e1-a5ef-4ee1-9cf0-ba5957a1ee4f tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Getting quotas for user ee0793093dbb4ab18379588ad441b1e8 and project f04c0694a50c4533859c8db8a7269b63. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:08.177422 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.185759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-484d677f-5f86-42c1-81af-e101484b36ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.286809 Aug 27 03:33:08.198419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 219/401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:07 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.353172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:08.354961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:08.362837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.363669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.364843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.365539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.442577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-a24d09e1-a5ef-4ee1-9cf0-ba5957a1ee4f tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Getting quotas for project f04c0694a50c4533859c8db8a7269b63. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:08.447640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-a24d09e1-a5ef-4ee1-9cf0-ba5957a1ee4f tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Getting quotas for user ee0793093dbb4ab18379588ad441b1e8 and project f04c0694a50c4533859c8db8a7269b63. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:08.466663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a24d09e1-a5ef-4ee1-9cf0-ba5957a1ee4f tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.353771 Aug 27 03:33:08.469053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 183/402] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Aug 27 03:33:08 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.491451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.492083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:08.502006 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.502503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.503449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.503976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.530886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-17294996-eae3-47cd-ad9f-739037ef972e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.183410 Aug 27 03:33:08.532280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 220/403] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:08 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:08.680718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-255281310", "imageRef": "ecf6b6e5-8eea-4483-ac75-cf3930a647bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-56621486", "networks": [{"uuid": "2b83c78b-c54e-4d49-9b7c-1ce1c073432b"}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:08.698302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.707455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b51b04a3-90cb-4e69-b0fd-2b25bae246cb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.221786 Aug 27 03:33:08.719951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 184/404] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:08 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.744805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.745795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:08.753305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.753735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.754592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.755031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.911797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.921066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.923604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.924870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6aa8a3f2-b4d4-4808-bfb0-2ad9eb848c49 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.183956 Aug 27 03:33:08.935837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 185/405] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:08 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:09.054643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] validate_networks() for [('2b83c78b-c54e-4d49-9b7c-1ce1c073432b', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:33:09.205498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.206317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:09.214006 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.226689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.227709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.228261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.539702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:09.578744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bb64d306-b26d-4570-b72a-0544d62e6268 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.377388 Aug 27 03:33:09.579937 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 186/406] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:09 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:09.588969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:09.601531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:09.621439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.622644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.631056 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.632039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.782053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dda68f86-6275-473e-ad70-dbbfdfdbd419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.198812 Aug 27 03:33:09.787062 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 187/407] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:09 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:09.800898 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.801718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:09.817421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.818129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.821645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.822121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.849573 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:09.850401 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:09.851063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:09.851642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:09.852221 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:09.877425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.878177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.879348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.879957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.904841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Getting quotas for project f04c0694a50c4533859c8db8a7269b63. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:09.912208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Getting quotas for user ee0793093dbb4ab18379588ad441b1e8 and project f04c0694a50c4533859c8db8a7269b63. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:09.933120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:33:09.940317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecf6b6e5-8eea-4483-ac75-cf3930a647bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:33:10.039068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dae04c1f-59b3-470c-96c8-304d54190c3d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355008 Aug 27 03:33:10.051209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 221/408] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:33:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:33:10.058891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.059879 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:10.071057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.071821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.072684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.073198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.579158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.589576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e29c5d49-fbbf-4215-970e-2037d9a705f0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.801059 Aug 27 03:33:10.590386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 188/409] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:09 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:10.607458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.608402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:10.622990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.624327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.625972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.626810 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.771467 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.775493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.790197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-46cf6a79-0e45-47ae-af4e-75eb7f5dcc96 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1260 microversion: 2.1 time: 0.190757 Aug 27 03:33:10.792336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 189/410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:10 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:10.794613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.799961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.803006 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.807469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b1d27b49-4d48-4a50-b6e8-66ba64fb2422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.749412 Aug 27 03:33:10.808759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:10.817493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 222/411] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:10 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:10.827903 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.828833 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:10.829768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.830499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:10.830790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.835594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.848549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.848717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.851294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.851707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.010607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-64e3d950-554d-4da5-bd59-d211d667a9d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.191516 Aug 27 03:33:11.015285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 223/412] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:10 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:11.103864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.117537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5d858cfd-7634-4d27-a864-4f08677e774e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.323734 Aug 27 03:33:11.119048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 190/413] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:10 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:11.608939 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.609535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:11.616552 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.617062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.617900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.618446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.808427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.809046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:11.822861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.823309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.824106 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.824538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.868107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.880908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b4eb1c56-302f-47be-b67b-4713677905ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.276948 Aug 27 03:33:11.883765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 224/414] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:11 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:11.898912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.899478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:11.910846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.911564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.912519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.913177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.954359 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.961992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-850738a8-0253-4758-be42-c8d0c909a75d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1326 microversion: 2.1 time: 0.157384 Aug 27 03:33:11.965187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 191/415] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:11 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.022892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:12.023872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:12.036703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.037270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.037948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.038418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.172685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b689ef80-95ac-416e-9ece-aed78dc1a48f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.153005 Aug 27 03:33:12.178817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 192/416] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:12 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:12.197924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.204545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:12.235085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.239591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.242751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.243388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.258932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.269293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.279554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.281347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-54f64d2b-919a-4f5d-8ef8-27a1b64a705e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.386935 Aug 27 03:33:12.290112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 225/417] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:11 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:12.671622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.683619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ea313d20-1c13-432d-b04d-44db4a50dfda tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.502818 Aug 27 03:33:12.698323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 193/418] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:12 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.901362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.901362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:12.912741 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.913455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.914505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.915096 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.984630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.986514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:13.003576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.006746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.007864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.014877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.540808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.563172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0697b6ea-dd9c-41e4-accd-ec769b9fedd4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.664136 Aug 27 03:33:13.582066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.587151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 226/419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:12 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:13.597737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-73ee080b-d238-4eeb-8d15-bccffc19b765 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.618665 Aug 27 03:33:13.598372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 194/420] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:12 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:13.606135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.606745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:13.608599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:13.609690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:13.618954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.619686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.621615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.622661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.623257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.628333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.629446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.630085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.841123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.852680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.860088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.861363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5ae64801-0162-4270-bd34-27d73b4acbcb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.262039 Aug 27 03:33:13.871965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 195/421] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:13 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:13.876832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.877449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:13.907090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.908127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.912554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.913137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:14.277837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.286316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b0b7fec4-32b9-42dd-9e83-6e8170a491d6 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.413151 Aug 27 03:33:14.286891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 196/422] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:13 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:14.603890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.604508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:14.620724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:14.621441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:14.622450 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:14.623447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.012495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.029144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bdb1745a-aad0-431c-b561-1cf90691c2d1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.428779 Aug 27 03:33:15.034782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 197/423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:14 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.040883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.047302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:15.065779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.074904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.076051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.076707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.343446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.354874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ff229b54-b0c5-4daa-a3cd-e7cc0a78d998 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.318362 Aug 27 03:33:15.356120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 198/424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:15 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.362540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.363468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:15.370932 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.371637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.372617 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.373213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.587605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.598939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.605470 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.607237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b8b4e721-d5fd-495d-970f-d84ca296a41e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.249315 Aug 27 03:33:15.609254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 199/425] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:15 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:15.624649 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.625611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:15.632496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.632935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.633717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.634172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.846792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.875698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8f07cb00-4067-44f1-a024-3b6d0872fdb7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.255500 Aug 27 03:33:15.877594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 200/426] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:15 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.059795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.060067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:16.075979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.080160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.081626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.081626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.480722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.515865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bb1932ee-6a5d-44c3-b046-4ffb47e80232 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.467971 Aug 27 03:33:16.544726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 201/427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:16 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.558426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.559045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:16.590667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.591288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.592950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.595269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.871663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.892163 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ec3de3bf-7974-4ba7-990a-15b44e746fa1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.346061 Aug 27 03:33:16.903456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 202/428] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:16 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.908183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.909226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:16.924796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.928526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.929944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.933550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.223804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.237923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.243473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.244622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-29d6201d-1bb8-4a5c-b361-fd835886d032 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.344247 Aug 27 03:33:17.254879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 203/429] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:16 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:17.254879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.254879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:17.272599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.273051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.273884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.274290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.518799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.530732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cf77508d-d0cf-47b9-aab4-dd1ee7f5ab0b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.284486 Aug 27 03:33:17.532050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 204/430] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:17 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.569636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.570658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:17.590602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.591361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.594681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.596510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.821318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.832734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0fdeaeb0-0ee3-410d-a862-8b2ae3125fc4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.274460 Aug 27 03:33:17.871041 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 205/431] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:17 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.915510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.917145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:17.939916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.942924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.949491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.950344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:18.137448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.148390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-980568df-2783-40ce-8e2c-3b2c5117c96e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.240021 Aug 27 03:33:18.159226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 206/432] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:17 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.277177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.277651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:18.295818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:18.295818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:18.295818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:18.295818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:18.563719 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.571975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.578548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.581307 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-603702a8-24e8-4663-b79d-2b98af92b066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.319084 Aug 27 03:33:18.582378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 207/433] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:18 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:18.587486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.588303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:18.603955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:18.604843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:18.608469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:18.610862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.010242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.021734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b786d3f6-1494-49ef-8970-b56b9267cf28 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.437585 Aug 27 03:33:19.023674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 208/434] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:18 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:19.031478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.032466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:19.044153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.049163 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.062121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.063272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.284411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.298123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6af24fd3-dd70-44fa-b9e0-b1fa27f9f963 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.272990 Aug 27 03:33:19.301076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 209/435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:19 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:19.315341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.317061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:19.331859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.332311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.333100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.333534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.639831 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.665599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ffa7d911-54b5-4a91-b675-bb54ce5c7a45 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.363146 Aug 27 03:33:19.683865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 210/436] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:19 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:19.683865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.683865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:19.704401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.705184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.710568 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.710793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.891620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.905494 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.911015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.913362 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-836011ac-30dc-4b2b-82cf-5d0b1fb85b41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.235541 Aug 27 03:33:19.914137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 211/437] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:19 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:19.940802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-8188be88-10c6-4da5-aa1b-135e9cae2805 req-b796de85-ff4b-40f2-9923-fad27cf2cd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bcfa74-f228-4e6c-842b-66a5cad93c7a", "name": "network-vif-plugged", "status": "completed", "tag": "e8511243-ef8e-4d2c-a8e0-aa94a2ff41d1"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:19.944423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:19.944423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:19.966520 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-8188be88-10c6-4da5-aa1b-135e9cae2805 req-b796de85-ff4b-40f2-9923-fad27cf2cd39 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.966520 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-8188be88-10c6-4da5-aa1b-135e9cae2805 req-b796de85-ff4b-40f2-9923-fad27cf2cd39 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.984423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-8188be88-10c6-4da5-aa1b-135e9cae2805 req-b796de85-ff4b-40f2-9923-fad27cf2cd39 service nova] Creating event network-vif-plugged:e8511243-ef8e-4d2c-a8e0-aa94a2ff41d1 for instance f8bcfa74-f228-4e6c-842b-66a5cad93c7a on hv-cinder-77398 Aug 27 03:33:20.000462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-8188be88-10c6-4da5-aa1b-135e9cae2805 req-b796de85-ff4b-40f2-9923-fad27cf2cd39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064432 Aug 27 03:33:20.000695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 212/438] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:20.040764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.041472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:20.053836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.054353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.055154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.055591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.310308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.325358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-86e8fe99-bb37-4934-af0d-e45dc7a1b7e2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.288530 Aug 27 03:33:20.326587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 213/439] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:20 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:20.335524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.336673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:20.356583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.358385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.361459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.362852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.697170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.716885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bf49cac8-2936-40f1-852d-cb6c392897d9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.388251 Aug 27 03:33:20.728688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 214/440] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:20 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:20.733983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.734961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:20.761095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.761692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.762433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.762880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.946091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.960474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9f28b783-f700-46ec-a2be-30621d847750 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.230228 Aug 27 03:33:20.961403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 215/441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:20 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:20.966811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.968319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:20.976726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.977420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.979767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.980371 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:21.272928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.281443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.283036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.284247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cd66b7c1-e033-4aae-bd1c-9f428b5d8aae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.321561 Aug 27 03:33:21.284827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 216/442] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:20 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:21.347600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.347600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:21.362999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:21.363459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:21.364300 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:21.364742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:21.662645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.672308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c82a08fb-90f5-4b12-81ae-79cd5cac6387 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.332825 Aug 27 03:33:21.674366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 217/443] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:21 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.737466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.739091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:21.751016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:21.759840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:21.762324 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:21.762773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:22.419672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:22.431342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7e8502cf-052d-4a57-8535-0daa1c9a57ad tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.700067 Aug 27 03:33:22.432346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 218/444] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:21 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:22.438282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:22.439209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:22.446428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:22.447284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:22.448417 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:22.449079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:22.731026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:22.738984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-241d4aee-c183-443a-969d-f2b87f5e32c8 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.305258 Aug 27 03:33:22.743179 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 219/445] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:22 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:22.747833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:22.752547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:22.767443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:22.769956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:22.770963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:22.776695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:23.032518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.059542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.061437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.067685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b57b0ab0-b344-4eb5-bbf1-74ed574bb160 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.323299 Aug 27 03:33:23.070320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 220/446] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:22 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:23.086976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.087591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:23.105328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:23.109934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:23.110798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:23.111235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:23.446258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.462675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2a80faf2-af9e-4356-bc1a-c885d646060c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.390883 Aug 27 03:33:23.463253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 221/447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:23 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:23.470145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.471932 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:23.480066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:23.480688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:23.481773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:23.483624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.100988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.109856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f8f112c5-3c3c-4106-a9a4-931b8bad90ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.645320 Aug 27 03:33:24.113605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 222/448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:23 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.120582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.124966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:24.131284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.131728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.132513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.132943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.381312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.391605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-76197e7b-67cd-4399-ae5a-afae641131b7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.274591 Aug 27 03:33:24.392331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 223/449] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:24 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.396955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.397638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:24.403485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.403996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.404912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.405409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.616032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.625224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.627550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.628986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a17a6fe4-e3e7-46ce-a6f8-16079ed41df7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.235640 Aug 27 03:33:24.630092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 224/450] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:24 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:24.651581 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.652332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:24.669878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.671246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.672033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.672467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.832223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.840948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-adb3db11-e626-4518-9b6c-37200d2d7978 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.209438 Aug 27 03:33:24.841736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 225/451] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:24 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:25.143328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.143995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:25.150594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.151157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.152030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.152536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.400014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:25.412739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7782cffb-7075-4896-ada3-854b235bff4e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.284466 Aug 27 03:33:25.413332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 226/452] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:25 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:25.419699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.425316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:25.443989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.444505 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.445336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.445947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.747983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:25.760752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0dbc55aa-6387-408b-8c86-c9d02e33f1f1 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.346015 Aug 27 03:33:25.774718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 227/453] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:25 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:25.786882 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.788197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:25.808123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.808662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.809620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.810153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.056834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.066388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.068827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.069922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-86aeb825-bb2a-4e0b-adff-1420077a24d2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.294142 Aug 27 03:33:26.081710 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 228/454] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:25 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:26.087540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.088552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:26.110655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.111884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.113023 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.113728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.363929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.383650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5474fb2e-3f24-439c-9f42-3d6047efdbf7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.299285 Aug 27 03:33:26.384262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 229/455] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:26 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:26.430325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.431225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:26.442430 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.445360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.446833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.449664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.679071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.691090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5bbfb889-10f1-4951-ac83-7a21d9acac3f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.264601 Aug 27 03:33:26.692178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 230/456] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:26 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:26.779599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.781005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:26.792297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.792840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.794895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.796084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:27.190282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.203147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-897fff3c-1f44-4d94-a8c7-c6a215101c78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.427567 Aug 27 03:33:27.204294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 231/457] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:26 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:27.208955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:27.213358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:27.225894 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:27.228466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:27.229426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:27.233391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:27.594513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.637662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.644543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.650290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1f09bff9-add7-4948-84ab-6eb2ae27e918 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.442048 Aug 27 03:33:27.651134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 232/458] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:27 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:27.660551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:27.661558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:27.679760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:27.680810 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:27.685513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:27.688518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.125098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.136957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-038609e7-b5dd-4dcc-8e18-2e9e645567ac tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.481900 Aug 27 03:33:28.137852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 233/459] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:27 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:28.144113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:28.153224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:28.166072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.178860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.179720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.180304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.488222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.499061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2f10a624-771c-4f49-9647-3f5379929c09 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.359347 Aug 27 03:33:28.499949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 234/460] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:28 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:28.515943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:28.516881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:28.526097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.526814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.527801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.528436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.858431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.876362 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-47f070b6-f543-4e7f-8e47-578cc36eaba7 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.364006 Aug 27 03:33:28.879682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 235/461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:28 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:28.885766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:28.886712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:28.894687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.895421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.896444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.896861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.193801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.203849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.205657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.207081 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-735509df-d4d0-462f-9ebb-f8377281f4fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.326015 Aug 27 03:33:29.207729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 236/462] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:28 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:29.216940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.217675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:29.224250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.224697 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.225573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.226171 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.504027 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.515201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6d036a26-d43a-4c9a-8dc4-0361b8b613f2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.305116 Aug 27 03:33:29.515834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 237/463] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:29 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:29.521498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.522373 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:29.537228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.538513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.539344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.539788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.072360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.114459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-250902d0-d4c5-4fd5-88b5-be5042633928 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.597192 Aug 27 03:33:30.118763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 238/464] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:29 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:30.119879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.120485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:30.126619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.127061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.127835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.128260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.329221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.354452 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8329f045-5113-46f9-bb4a-459553210473 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.237647 Aug 27 03:33:30.355087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 239/465] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:30 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:30.359625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.360485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:30.375667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.376384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.377334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.377917 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.588093 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.596940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.598953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.600320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b80397d7-b151-4349-babf-fa3de15ffd8c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.244288 Aug 27 03:33:30.601391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 240/466] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:30 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:30.606204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.606996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:30.613897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.614366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.615132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.615555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.769418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.777060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8d30f497-26ac-40e9-b4e4-206312fb7316 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.174434 Aug 27 03:33:30.777918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 241/467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:30 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.133362 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.135276 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:31.143432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.144166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.145667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.146054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.309424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.321789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9bf6a29e-0e3c-4208-a9fc-8838a49afe0e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.192250 Aug 27 03:33:31.322777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 242/468] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:31 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.375172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.376380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:31.389963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.390847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.392546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.393355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.612090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.622168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d82db729-db52-4b54-8a99-1eee897d535e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.253981 Aug 27 03:33:31.623066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 243/469] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:31 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.637855 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.638795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:31.648350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.648802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.649959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.650493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.796654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-50dfce35-c75d-4478-a4f8-2d73f0747d7c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 18.200696 Aug 27 03:33:31.797806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 227/470] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:13 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 18210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:31.806568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.807286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:31.829111 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.829570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.830589 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.831181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.165051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.180681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.185841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.189615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-72a6b68f-d70a-4fa5-a768-e171fb5031c3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.554236 Aug 27 03:33:32.190495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 244/471] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:31 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:32.210928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.218338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bb92ed69-a705-487b-8845-428f8892c33f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.419205 Aug 27 03:33:32.218928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 228/472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:31 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:32.339858 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.341020 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:32.349716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.350482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.351621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.352209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.681534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.691476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6fcb166f-b73c-48bb-8aa6-2957701c8bb2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.356210 Aug 27 03:33:32.695347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 245/473] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:32 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:32.703952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.706451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:32.722961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.723419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.724352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.724812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.862523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-95fea6ca-a7d0-49f4-829c-5f3602d88c2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Action: 'create', calling method: .version_select at 0x7fb13083e040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-699246540"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:32.897955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-95fea6ca-a7d0-49f4-829c-5f3602d88c2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:32.904030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-95fea6ca-a7d0-49f4-829c-5f3602d88c2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for user 6883257742b64642887adffbe4f0a725 and project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:32.944570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.953099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3e452535-95bc-435a-aea9-0e4f244928ce tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.256503 Aug 27 03:33:32.953963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 246/474] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:32 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:32.972816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-deb26c3a-dede-4073-a694-8c928d6ace11 req-69c5e672-99ef-40b0-8aa2-7f497b49b719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:32.975075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:32.975075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:32.984183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-deb26c3a-dede-4073-a694-8c928d6ace11 req-69c5e672-99ef-40b0-8aa2-7f497b49b719 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.985175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-deb26c3a-dede-4073-a694-8c928d6ace11 req-69c5e672-99ef-40b0-8aa2-7f497b49b719 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.997579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-deb26c3a-dede-4073-a694-8c928d6ace11 req-69c5e672-99ef-40b0-8aa2-7f497b49b719 service nova] Creating event network-changed:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:33:33.004843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-deb26c3a-dede-4073-a694-8c928d6ace11 req-69c5e672-99ef-40b0-8aa2-7f497b49b719 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048998 Aug 27 03:33:33.007083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 247/475] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:33.012354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:33.013775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.022760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.023491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.024492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.025087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.155355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-26645b10-19d0-4945-a0b5-5315f9c3d8db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.146093 Aug 27 03:33:33.156808 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 248/476] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:33 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:33.209420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.210098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.220699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.221176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.222086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.222904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.239217 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-95fea6ca-a7d0-49f4-829c-5f3602d88c2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:33.242981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-95fea6ca-a7d0-49f4-829c-5f3602d88c2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for user 6883257742b64642887adffbe4f0a725 and project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:33.255705 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-95fea6ca-a7d0-49f4-829c-5f3602d88c2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.686601 Aug 27 03:33:33.256303 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 229/477] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Aug 27 03:33:32 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:33.260583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.261511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.267474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.270230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.278805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.279288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.406609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.415949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.417724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.419003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f889f85d-4513-41a6-bf98-42ad9ae5076f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.214552 Aug 27 03:33:33.420167 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 249/478] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:33 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:33.501746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.516465 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-83cd521c-f930-45ab-8bb2-f35a1d959b14 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.259097 Aug 27 03:33:33.517129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 230/479] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:33 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:33.714851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.715696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.725615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.726117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.727861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.729712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.980021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.980854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.989548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.990370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.006735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.007667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.022089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.039536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5fbdf97d-ea33-450e-94d3-708df5822aa3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.332591 Aug 27 03:33:34.050241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 250/480] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:33 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:34.166876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:34.167848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:34.174785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.175293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.176256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.176406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.258193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.267147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c3b1a673-9666-4e7b-a565-1bc7ab6cc989 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.300007 Aug 27 03:33:34.276717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 231/481] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:33 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:34.440848 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:34.441788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:34.455543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.455993 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.456774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.458129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.613319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e0848065-ffd5-41b6-836d-3b9bc6489b3a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.450153 Aug 27 03:33:34.613951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 251/482] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:34 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:34.621466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:34.622923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:34.630555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.631764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.632654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.633599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.699699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.710782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.716610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.722967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e97112fc-2cf4-469a-8583-9d6b511b4cc4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.283531 Aug 27 03:33:34.724049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 232/483] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:34 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:34.939990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.958295 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-842cb5d7-79c2-4c56-942e-3e52624b4cc3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1318 microversion: 2.1 time: 0.342548 Aug 27 03:33:34.959206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 252/484] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:34 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.058763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.059958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.067417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.068234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.069544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.070465 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.269211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.284757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.285734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.289256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1c1b0ee1-df92-4d66-b7d3-5ceddff79ef5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1502 microversion: 2.1 time: 0.223074 Aug 27 03:33:35.305333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 233/485] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.308599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.310193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.313957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.314767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.318051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87307e2b-797a-4dbb-b67d-5dd3f8ded7c0"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:35.320849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.343093 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.343849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.345278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.346077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.396670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] HTTP exception thrown: Cannot 'attach_volume' instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c while it is in vm_state rescued Aug 27 03:33:35.397406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Returning 409 to user: Cannot 'attach_volume' instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c while it is in vm_state rescued {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:33:35.398566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-618f04ec-2907-4b93-9599-977ca712cd93 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091909 Aug 27 03:33:35.399377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 234/486] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:33:35 2021] POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:33:35.411521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:35.412124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.419665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.420437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.421587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.422245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.585731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-608ebab0-d64c-457c-aafb-667625432719 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action" status: 202 len: 0 microversion: 2.1 time: 0.167436 Aug 27 03:33:35.585731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 235/487] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:35 2021] POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:35.602511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.603678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.612823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.613554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.614534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.615129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.617126 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.626751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d04256b4-970a-43dc-890c-2279b0bf1d11 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.345921 Aug 27 03:33:35.628011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 253/488] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:35.633341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:35.634562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.641914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.642682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.643660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.644281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.784202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-20e82f7d-ed22-42e9-a204-de0e48a82792 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.153682 Aug 27 03:33:35.785272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 254/489] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:35 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:35.794326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.796545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.804706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.805493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.806393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.806906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.920648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.929237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-72ad3a6c-f9d4-4844-a669-062ac6d178f9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1510 microversion: 2.1 time: 0.334827 Aug 27 03:33:35.930812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 236/490] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.976988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.977633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.985478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.985958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.986786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.987191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.101436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.121232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.122788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.124009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c0174457-e1d8-4fd1-b067-4a08a19d7470 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.336771 Aug 27 03:33:36.124677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 255/491] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:36.259173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.272095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-66e9092f-2c32-4674-a103-19b51a31fe91 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1509 microversion: 2.1 time: 0.299173 Aug 27 03:33:36.272682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 237/492] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:36.644383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:36.644997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:36.653742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.654214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.655718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.656155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.789715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.797554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:36.798478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-80ac69ac-a67c-4178-bb94-a9db9442941c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.157890 Aug 27 03:33:36.798961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:36.806109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 256/493] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:36 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:36.806295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.806295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.806295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.806662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.922852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-992c971b-b232-46d7-a28f-1d78e74310e9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.129469 Aug 27 03:33:36.923513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 238/494] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:36 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:36.947486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:36.948291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:36.960910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.961725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.962792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.963492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.100622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.109693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9a1918f1-9431-43aa-91a9-b03fd691609a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1510 microversion: 2.1 time: 0.165843 Aug 27 03:33:37.110301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 257/495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:36 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:37.142511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.143209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.150832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.151282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.152073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.152508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.277892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.286917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.288624 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.290040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6c5bce0c-f30f-432d-a477-3bff6b77eebc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.152440 Aug 27 03:33:37.290724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 239/496] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:37 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:37.699669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "625506b6-654a-48aa-9e49-29b3014b7cc1"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:37.701850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.715340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.715789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.716578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.717006 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.815409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.816017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.821830 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.822315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.823075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.823511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.960360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.968584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-75effbb3-caa7-4363-9992-fdfec72c283b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.157081 Aug 27 03:33:37.969148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 240/497] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:37 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:37.973909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:37.974876 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.981677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.982375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.984294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.984948 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.027400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-34aa9701-2d25-411c-b030-90d3a3cff042 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331451 Aug 27 03:33:38.028013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 258/498] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:33:37 2021] POST /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:38.128186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.128673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4e809876-18cd-4698-9f9c-f59f6f7ad34b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.157830 Aug 27 03:33:38.129323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:38.129664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 241/499] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:37 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:38.135723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.136170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.136929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.137352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.267131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.274768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1ddd6fb8-5b4c-4f9c-b853-7580178f7ddb tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1510 microversion: 2.1 time: 0.151857 Aug 27 03:33:38.275340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 259/500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:38 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:38.308717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.309482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:38.316353 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.316859 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.317680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.318142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.442579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.450298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.452464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.453581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-47466344-eeeb-44f4-99de-0dad758f2473 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.149079 Aug 27 03:33:38.454158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 242/501] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:38 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:38.920004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-5da890bf-d6a9-4c22-b7df-e35beba92a72 req-b71af53f-4adc-4ae2-be3e-4467ec92dbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:38.923015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:38.923015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:38.931859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-5da890bf-d6a9-4c22-b7df-e35beba92a72 req-b71af53f-4adc-4ae2-be3e-4467ec92dbe1 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.932749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-5da890bf-d6a9-4c22-b7df-e35beba92a72 req-b71af53f-4adc-4ae2-be3e-4467ec92dbe1 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.945459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-5da890bf-d6a9-4c22-b7df-e35beba92a72 req-b71af53f-4adc-4ae2-be3e-4467ec92dbe1 service nova] Creating event network-vif-plugged:4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8 for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 on hv-cinder-77398 Aug 27 03:33:38.950360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-5da890bf-d6a9-4c22-b7df-e35beba92a72 req-b71af53f-4adc-4ae2-be3e-4467ec92dbe1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 Aug 27 03:33:38.950962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 260/502] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:38.986748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.987459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:38.994631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.995197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.996094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.996601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.143567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:39.145634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:39.155831 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.156477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.157397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.158224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.163609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.177260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2ddfe405-f57a-4952-a931-b7e849e3c625 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.195400 Aug 27 03:33:39.177850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 243/503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:38 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:39.269577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-275c04d8-9147-405a-bbe0-661a6f7ff09b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.132051 Aug 27 03:33:39.273357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 261/504] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:39 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:39.291943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:39.292554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:39.299074 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.299452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.300212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.300642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.433819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.442615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-76f0570e-21ff-4bf7-bdab-0c14b5d01873 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1510 microversion: 2.1 time: 0.154317 Aug 27 03:33:39.443191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 244/505] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:39 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:39.472348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:39.473080 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:39.481852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.482277 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.483787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.484301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.859484 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.867917 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.869662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.870957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2b271f29-f0b8-4fb8-b75e-7bbb17fb1b3a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.403925 Aug 27 03:33:39.871560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 262/506] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:39 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:40.193496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.194274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.200872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.201324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.203402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.203848 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.281347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:40.282358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.288294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.288779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.289519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.289955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.329679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:40.337840 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-788f6606-1daf-4177-bd17-566ae50b80dd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.147873 Aug 27 03:33:40.338453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 245/507] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:40 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:40.458963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.459634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.465301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.465751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.466546 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.466986 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.599256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:40.606439 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2712ce21-d5e8-486a-b679-b63bc7abf58e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1510 microversion: 2.1 time: 0.151179 Aug 27 03:33:40.607037 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 246/508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:40 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:40.621602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4e80ffc4-fe48-46d9-a0a6-5ab9f6a6c4bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.344239 Aug 27 03:33:40.622708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 263/509] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:40 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:40.888337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.888936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.895521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.895960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.896717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.897146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.026442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.035918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.037453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.038642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-56294f43-e400-4b7e-b822-90c6b35eeb02 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1406 microversion: 2.20 time: 0.154035 Aug 27 03:33:41.039210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 247/510] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:40 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:41.355628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:41.356328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:41.366826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.367287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.368169 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.368657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.495883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.503080 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0f92b30d-c74b-4a0a-b20f-e31b77e75c79 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.151464 Aug 27 03:33:41.503645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 264/511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:41 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:41.624867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:41.625480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:41.633291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.633745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.634334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:41.634715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.635196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.635554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:41.642232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.642719 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.643495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.643931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.761077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.769775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a9990536-9409-482e-8d54-e8c63fd12f46 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1516 microversion: 2.1 time: 0.148782 Aug 27 03:33:41.770569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 248/512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:41 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:41.772770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-20bb372c-c06f-40a9-94bd-89d20bfa19e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.142314 Aug 27 03:33:41.777132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 265/513] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:41 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:42.056695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.057842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:42.064394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.064924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.065700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.066174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.191606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.199968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.201455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.202858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-774f33af-1431-4b39-ba0f-2b88862a3cab tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1598 microversion: 2.20 time: 0.149707 Aug 27 03:33:42.203579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 249/514] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:42 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:42.221187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.221770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:42.228231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.228672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.229432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.229852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.312976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fd46b84e-888e-4a77-a095-a020d5ba8a06 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096004 Aug 27 03:33:42.313605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 266/515] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Aug 27 03:33:42 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:42.519842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.520372 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:42.529783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.530371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.531868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.532475 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.688323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-c8a5000e-af08-4e40-a9c9-fd4f232a1983 req-ace149f7-cde5-4d77-80b5-9281575eb1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "name": "network-vif-plugged", "status": "completed", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:42.690630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:42.690630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:42.698877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c8a5000e-af08-4e40-a9c9-fd4f232a1983 req-ace149f7-cde5-4d77-80b5-9281575eb1fb service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.699406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c8a5000e-af08-4e40-a9c9-fd4f232a1983 req-ace149f7-cde5-4d77-80b5-9281575eb1fb service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.712397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-c8a5000e-af08-4e40-a9c9-fd4f232a1983 req-ace149f7-cde5-4d77-80b5-9281575eb1fb service nova] Creating event network-vif-plugged:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:33:42.717978 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-c8a5000e-af08-4e40-a9c9-fd4f232a1983 req-ace149f7-cde5-4d77-80b5-9281575eb1fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Aug 27 03:33:42.719282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 267/516] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:42.793931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.795025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:42.796666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:42.803753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-868c9a1f-cfa9-4ecc-bcba-87195653fabd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.287314 Aug 27 03:33:42.810763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.811215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.813174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.813707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.815629 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 250/517] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:42 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:42.940540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f7cfa05d-5357-4ea6-9531-fb1f68ff6b25 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.158412 Aug 27 03:33:42.944973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 268/518] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:42 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:43.453432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:43.458902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-268c5611-9976-4bfb-b440-18348606b398 req-9778cd2f-72cf-43ef-8015-10acc53b8592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:43.460367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:43.460367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:43.464942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:43.471857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.472044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-268c5611-9976-4bfb-b440-18348606b398 req-9778cd2f-72cf-43ef-8015-10acc53b8592 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.472421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-268c5611-9976-4bfb-b440-18348606b398 req-9778cd2f-72cf-43ef-8015-10acc53b8592 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.472538 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.473318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.473822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.483365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-268c5611-9976-4bfb-b440-18348606b398 req-9778cd2f-72cf-43ef-8015-10acc53b8592 service nova] Creating event network-changed:4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8 for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 on hv-cinder-77398 Aug 27 03:33:43.489001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-268c5611-9976-4bfb-b440-18348606b398 req-9778cd2f-72cf-43ef-8015-10acc53b8592 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033995 Aug 27 03:33:43.489796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 269/519] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:43.821923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:43.822688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:43.829894 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.830793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.832297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.836025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.847442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3564fef2-b415-4348-940a-0fe8910e05e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.397931 Aug 27 03:33:43.849762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 251/520] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:43 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:43.953038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:43.955050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:43.974440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.974899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.975699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.976146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.045384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:44.054197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-913dd534-01b5-4683-b6ab-cf8a1e3b79c5 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.236090 Aug 27 03:33:44.054935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 270/521] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:43 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:44.174668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1da729e9-dcbb-4718-9dab-4bd8378f7898 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.225812 Aug 27 03:33:44.176898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 252/522] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:43 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:44.204322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:44.205340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:44.211931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.212859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.214228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.214885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.439294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:44.450487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-29d6b1ff-f87c-4ab8-8f9f-a93df31b0bb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1516 microversion: 2.1 time: 0.251266 Aug 27 03:33:44.461616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 271/523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:44 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:44.467487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02d70aa2-1e40-4f9b-97aa-445060457977"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:44.469373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:44.476235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.476679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.477557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.477989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.795110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aa185aa9-ed23-4e22-86de-eebeb112a8b3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331508 Aug 27 03:33:44.795721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 253/524] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:33:44 2021] POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:44.860626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:44.862244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:44.868957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.869467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.870259 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.870689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.067728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-48ae4cfb-5e6d-4ab8-a0b2-9f84d38d0125 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.211635 Aug 27 03:33:45.068357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 272/525] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:44 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:45.072367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:45.073120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:45.079951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.080405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.081203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.081638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.188263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:45.189533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:45.197734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.198305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.199178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.199706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.216979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:45.225884 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ec958567-e3ca-44c7-a2ec-e2326a603672 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1356 microversion: 2.1 time: 0.157724 Aug 27 03:33:45.226742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 254/526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:45 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:45.329573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e21d026f-fbf9-40de-9ccc-1cb3fadce427 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.145738 Aug 27 03:33:45.330246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 273/527] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:45 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:46.079813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:46.080718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.087481 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.088173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.088965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.089464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.198549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d6443e9c-0d07-4eb1-b895-e7e7f340c363 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.123586 Aug 27 03:33:46.199182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 255/528] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:46 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:46.244079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.244823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.252057 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.252505 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.253272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.253704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.341183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:46.342261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.350028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.350489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.351302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.351740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.375810 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.384235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1524afc8-5e3a-440f-82be-20d719fa63bf tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1545 microversion: 2.1 time: 0.144367 Aug 27 03:33:46.384805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 274/529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:46 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1545 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:46.400515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.401121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.407846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.408366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.409208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.409711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.470224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ac4650bd-8cf8-4ea5-b87e-917a7a2e7650 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.132835 Aug 27 03:33:46.474387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 256/530] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:46 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:46.545784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.553045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-24a87d38-aadf-4a1d-ab6d-ac7b0e85f152 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1545 microversion: 2.1 time: 0.155898 Aug 27 03:33:46.553955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 275/531] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:46 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:46.569665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.573383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:46.573383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:33:46.574846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.575800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Searching by: {'deleted': False, 'project_id': 'f04c0694a50c4533859c8db8a7269b63'} {{(pid=109037) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 27 03:33:46.583530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.584167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.584753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.585182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.664412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "625506b6-654a-48aa-9e49-29b3014b7cc1"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:46.665523 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.671843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.672262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.673142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.673588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.681764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.multi_cell_list [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=109037) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 27 03:33:46.761050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] HTTP exception thrown: Invalid volume: volume 625506b6-654a-48aa-9e49-29b3014b7cc1 is already attached to instances: f8bcfa74-f228-4e6c-842b-66a5cad93c7a Aug 27 03:33:46.761778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Returning 400 to user: Invalid volume: volume 625506b6-654a-48aa-9e49-29b3014b7cc1 is already attached to instances: f8bcfa74-f228-4e6c-842b-66a5cad93c7a {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:33:46.762693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7ed3dd34-40f5-418d-895b-0897bb4a5d6e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102541 Aug 27 03:33:46.763233 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 276/532] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:33:46 2021] POST /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:33:46.782958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-30b32813-c397-41a4-b8e7-e2b744cb9291 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.217237 Aug 27 03:33:46.783867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 257/533] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Aug 27 03:33:46 2021] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:46.794992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.795609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.802117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.802562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.803699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.804448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.839885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.840495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.847383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.847826 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.848603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.849038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.942412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'services' on Instance uuid f8bcfa74-f228-4e6c-842b-66a5cad93c7a {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:46.954996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.963158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4c98aa4a-eec6-48c0-ae4f-361e8d98503a tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1545 microversion: 2.1 time: 0.172514 Aug 27 03:33:46.969534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 277/534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:46 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1545 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:47.020704 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c94274e2-8afb-4a42-b3dd-b6aff2d3c7bc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments/625506b6-654a-48aa-9e49-29b3014b7cc1" status: 202 len: 0 microversion: 2.1 time: 0.184341 Aug 27 03:33:47.024613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 258/535] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:33:46 2021] DELETE /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments/625506b6-654a-48aa-9e49-29b3014b7cc1 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:33:47.029850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:47.030776 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:47.036576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.037016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.037797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.038246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.073794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c74b3056-3997-42c3-83d0-d3066792cd72 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047756 Aug 27 03:33:47.075523 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 278/536] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:47 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:47.209231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:47.210417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:47.216978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.217478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.218341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.219586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.334664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7ee3afed-32e2-4b55-b39d-8ff58e5dc26c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.129063 Aug 27 03:33:47.335361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 259/537] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:47 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:47.481627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:47.482581 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:47.489272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.489720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.490525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.490958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.605673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e171d67c-75e2-4066-8496-11f747e963c1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.127659 Aug 27 03:33:47.606350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 279/538] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:47 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:48.087207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.088288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:48.095926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.096373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.097161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.097590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.144643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a3cf1b9e-9eb7-48b3-ad0c-ce461ad540b1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061286 Aug 27 03:33:48.145654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 260/539] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:48 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:48.346349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:48.347340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:48.353724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.354197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.354953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.355375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.456292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-57e6047f-3917-4390-abbe-33196aaff061 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.114311 Aug 27 03:33:48.459525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 280/540] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:48 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.616900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:48.617814 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:48.624020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.624486 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.625349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.625780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.732067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aad1b0f5-6b69-4af7-8a48-4bec243e9d50 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 28911 microversion: 2.1 time: 0.118809 Aug 27 03:33:48.732716 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 261/541] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:48 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 28911 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:49.156819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:49.157953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:49.164623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.165100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.165915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.166416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.197136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bea8942b-64e9-4a87-a3fb-b4ecbc7ec631 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Aug 27 03:33:49.197645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 281/542] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:49 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:49.468234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:49.469409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:49.476135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.477104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.477384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.477820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.585816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30242294-a132-4d9b-b58b-a49845b4d665"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:49.586893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:49.592693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.593760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.594704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.595166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.601769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2e626897-7639-4488-ab5c-ee4f3a7b0e58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.137717 Aug 27 03:33:49.602858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 262/543] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:49 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:49.743609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:49.744605 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:49.751404 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.751844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.752634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.753059 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.883852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-92b1f547-ebc3-4050-a126-b7a6f21a7522 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301506 Aug 27 03:33:49.884374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 282/544] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:33:49 2021] POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:49.909989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cf04fa43-fa11-4b3c-9c5c-77d2c73940a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 29902 microversion: 2.1 time: 0.170472 Aug 27 03:33:49.910850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 263/545] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:49 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 29902 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:50.209833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.210962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:50.217595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.218794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.219724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.220164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.253557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6e6490ba-0438-4d3f-ad95-a82a68c0fbdd tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047720 Aug 27 03:33:50.254185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 283/546] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:50 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:50.613934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:50.614947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:50.621314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.621752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.622536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.622961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.726813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3a47a205-5439-4b67-a59d-7cc5c9ab1530 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.116717 Aug 27 03:33:50.727456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 264/547] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:50 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:50.923062 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:50.924963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:50.933007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.933674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.934655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.935099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.083997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5f3223dc-3a20-4f47-a1c3-92f5da89f002 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 31041 microversion: 2.1 time: 0.164955 Aug 27 03:33:51.084707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 284/548] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:50 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 31041 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:51.267698 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:51.268722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:51.276027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.276476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.277276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.277708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.310985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a4030d11-83ef-49cb-8575-8bad3f201a67 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048737 Aug 27 03:33:51.312098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 265/549] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:51 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:51.738525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:51.739539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:51.746277 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.746613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.747394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.747819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.919438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3c353a52-8372-4afa-985e-277d2797bba6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.185297 Aug 27 03:33:51.920209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 285/550] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:51 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:52.095165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:52.096066 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:52.102036 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.102592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:52.103356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.103784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:52.238210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-07ded3a7-ae97-48d2-8d59-ede1fd8d15c7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 31789 microversion: 2.1 time: 0.145666 Aug 27 03:33:52.242329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 266/551] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:52 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 31789 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:52.324127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:52.325117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:52.331874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.332312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:52.333067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.333493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:52.368234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-be2ca156-91c6-430c-b421-a11a759911d3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048154 Aug 27 03:33:52.368812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 286/552] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:52 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:52.931547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:52.932542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:52.939320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.939765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:52.940533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.940963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.057047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cedf3737-78ae-428c-aca5-ac7685e1ef93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.129426 Aug 27 03:33:53.057677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 267/553] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:52 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:53.251243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:53.252363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:53.258824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:53.259263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.260022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:53.260447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.380488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:53.381516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:53.387963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:53.388408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.389164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:53.389797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.412842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5837b862-2d07-4775-8686-aaba4e3726da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 32632 microversion: 2.1 time: 0.165835 Aug 27 03:33:53.415024 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 287/554] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:53 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 32632 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:53.420072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3749e01e-d365-4b9d-880f-40d9dd4b5537 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Aug 27 03:33:53.420653 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 268/555] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:53 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:54.069049 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:54.070120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.076547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.076986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.078428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.078854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.232347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6958bc1a-dd01-4c5d-b62d-9a77c46c39fc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.167186 Aug 27 03:33:54.233114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 288/556] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:54 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:54.424997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:54.426116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.432151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.432596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.433125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.433564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.433780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.434136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.441867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.442374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.443195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.443570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.484634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-75e60c12-a9bf-4495-9786-c23813fa29b3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055365 Aug 27 03:33:54.485278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 289/557] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:54 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:54.490635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:54.491974 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.499060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.500363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.500993 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.501569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.537065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lazy-loading 'flavor' on Instance uuid 248b6ca4-52d6-42f2-8ab8-823ee2872a2c {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:54.565224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ef4f837e-696b-40e4-9c3a-fd8402d93f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 34595 microversion: 2.1 time: 0.143801 Aug 27 03:33:54.566891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 269/558] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:54 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 34595 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:54.660306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dc836022-09f6-4c14-b340-e1f441790646 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action" status: 200 len: 32 microversion: 2.1 time: 0.173735 Aug 27 03:33:54.660823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 290/559] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:54 2021] POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:33:54.670549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.671980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.678432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.678914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.679749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.680185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.901333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.914306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d56f416f-3230-46d5-973f-de8e30ce4e28 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.247488 Aug 27 03:33:54.915098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 270/560] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:54 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:55.244863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:55.245973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:55.253223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.253669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.254488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.254917 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.375604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-46e39dd8-11c5-430d-8f46-77642e6de31b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.134871 Aug 27 03:33:55.376336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 291/561] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:55 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:55.496893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:55.497808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:55.504314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.504765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.505542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.505974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.538768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1681925b-23f1-479e-b77f-ab755caff3da tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045565 Aug 27 03:33:55.540271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 271/562] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:55 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:33:55.580417 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:55.581574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:55.596865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.597351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.598243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.598722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.778260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-864184020", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "813150a5-dbda-4897-a617-3b0468d8dcc8"}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:55.804358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9a1a0181-281e-41a3-83ca-6775cc85d1e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 35061 microversion: 2.1 time: 0.228480 Aug 27 03:33:55.805007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 292/563] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:55 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 35061 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:55.832155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] validate_networks() for [('813150a5-dbda-4897-a617-3b0468d8dcc8', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:33:55.932381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:55.933297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:55.940253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.940879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.941582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.942035 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.161866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.170032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ddbbb757-24ba-443b-af09-b021d83ca10c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.241728 Aug 27 03:33:56.170636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 293/564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:55 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:56.281792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:56.282309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:56.282885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:56.283364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:56.284003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:56.297511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.297954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.298796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.299227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.316215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:56.320294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Getting quotas for user 509234c4194142a4b0634c6f08776161 and project 6d9e01c1992d424c8ea95add2a0ee8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:56.331809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:33:56.334147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:33:56.380585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6bbff2df-38d5-4ad0-b7a7-29c5ed73c79d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606813 Aug 27 03:33:56.381810 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 272/565] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:33:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:33:56.387510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:56.388513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:56.392028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e8e1b3c1-6457-4ad2-8e9b-755ea8e17b02 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.392903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e8e1b3c1-6457-4ad2-8e9b-755ea8e17b02 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:56.395016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.395468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.396316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.396744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.458287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e8e1b3c1-6457-4ad2-8e9b-755ea8e17b02 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.465821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e8e1b3c1-6457-4ad2-8e9b-755ea8e17b02 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1217 microversion: 2.1 time: 0.078752 Aug 27 03:33:56.467277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 273/566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:56 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:56.554768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ae1f731d-1d66-408c-8beb-e7f7b21b5a2b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.171086 Aug 27 03:33:56.555612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 294/567] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:56 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:56.817625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:56.819293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:56.825170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.825548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.826350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.826787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.021978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-deb63c92-7b7d-40cb-aeae-fed3ac8b7bbd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 35835 microversion: 2.1 time: 0.207946 Aug 27 03:33:57.026101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 274/568] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:56 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 35835 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:57.189101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.189707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:57.196981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.197574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.198531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.199078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.321988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.331302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e1961b80-c6bc-4c28-82d4-f230af8e453e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.147346 Aug 27 03:33:57.331872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 295/569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:57 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:57.485151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.486170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:57.492963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.493404 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.494203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.494638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.558383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.565813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:57.566931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:57.573244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.573687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.574499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.575103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.576614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1c2b7715-d2ad-48f4-b2e9-cf852e16f813 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1269 microversion: 2.1 time: 0.096304 Aug 27 03:33:57.577318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 275/570] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:57 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:57.735301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bd53d5db-fd48-4401-87f2-02b555e76796 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.173957 Aug 27 03:33:57.735813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 296/571] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:57 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:58.034764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:58.035595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:58.041468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.041921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.043981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.043981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.172462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1fc435fa-1cc8-4072-b5c7-e5c485811ba6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 36332 microversion: 2.1 time: 0.141636 Aug 27 03:33:58.173658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 276/572] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:58 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 36332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:33:58.351605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:58.352598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:58.360070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.360753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.361534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.361964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.560786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:58.570308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1f33bba0-876c-4091-866d-f6a7ed30ef4d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.224894 Aug 27 03:33:58.571460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 297/573] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:58 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:58.596918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:58.597984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:58.604685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.605136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.605913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.606374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.746907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:58.747999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:58.762677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.763228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.764141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.765090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.855161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:58.864562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be84bf12-0c71-4904-9a75-1dd973477400 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.273512 Aug 27 03:33:58.865297 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 277/574] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:58 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:58.896964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f7ead79d-5650-4b9c-8848-3e4f5bd6c19c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.153926 Aug 27 03:33:58.900058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 298/575] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:58 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:59.188476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:59.190267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:59.197957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.199045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.200005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.200690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.214651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-5bf028e4-6038-4dcd-a05d-51beb90d89e5 req-e24c0b04-0801-4c13-8c44-f96cfa55e24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "708e412a-5d6c-4e12-af72-0a9bc472dbb7", "tag": "f2990968-bc26-42a3-a2a7-59f3828f8ac7"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:59.216375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:59.216375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:33:59.231228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-5bf028e4-6038-4dcd-a05d-51beb90d89e5 req-e24c0b04-0801-4c13-8c44-f96cfa55e24e service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.231928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-5bf028e4-6038-4dcd-a05d-51beb90d89e5 req-e24c0b04-0801-4c13-8c44-f96cfa55e24e service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.244482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-5bf028e4-6038-4dcd-a05d-51beb90d89e5 req-e24c0b04-0801-4c13-8c44-f96cfa55e24e service nova] Creating event network-changed:f2990968-bc26-42a3-a2a7-59f3828f8ac7 for instance 708e412a-5d6c-4e12-af72-0a9bc472dbb7 on hv-cinder-77398 Aug 27 03:33:59.257086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-5bf028e4-6038-4dcd-a05d-51beb90d89e5 req-e24c0b04-0801-4c13-8c44-f96cfa55e24e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047072 Aug 27 03:33:59.257682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 299/576] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:59.365051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-11a29ad8-b642-4424-b948-9e6cde1861c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 37020 microversion: 2.1 time: 0.183088 Aug 27 03:33:59.365745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 278/577] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:59 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 37020 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:33:59.588026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:59.588796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:59.598811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.599255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.600022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.600449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.857850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.866325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fe4c79e1-8338-48f4-9d5f-e8a0c52cfeb5 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.282353 Aug 27 03:33:59.869516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 300/578] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:59 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:59.885237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:59.886257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:59.895423 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.896121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.897261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.897950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.907712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:59.908665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:59.914692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.915142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.915913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.916346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:00.021479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2721d1f8-737b-42bb-a224-d8b6636b01b0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.116969 Aug 27 03:34:00.022661 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 301/579] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:33:59 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:00.087019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.095119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8b669fdf-7e04-4a3c-b53d-197ea12f1661 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.216176 Aug 27 03:34:00.095693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 279/580] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:59 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:00.378328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:00.379612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:00.390417 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:00.391249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:00.392209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:00.392890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:00.884222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.884830 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:00.892541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:00.893026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:00.893801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:00.894295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:01.021503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:01.029644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ad09a634-9d43-4c83-ac3c-7c0ac3fdba48 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.149169 Aug 27 03:34:01.030519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 280/581] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:00 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:01.035412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:01.036319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:01.042285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:01.042736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:01.043511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:01.043945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:01.058334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b095bf4b-f2da-472d-a986-0edf06703262 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 38354 microversion: 2.1 time: 0.684735 Aug 27 03:34:01.063614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 302/582] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:00 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 38354 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:01.113097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:01.113737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:01.120767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:01.121205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:01.121968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:01.122415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:01.175061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e463028d-19b1-42a6-b564-7752748f6f8a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 14 microversion: 2.20 time: 0.142876 Aug 27 03:34:01.175774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 281/583] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:01 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:01.255799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:01.264177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c7a06ad8-d7e3-487c-872a-2f41185b06ea tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.155448 Aug 27 03:34:01.265061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 303/584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:01 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:02.047290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:02.047987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:02.054592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.055101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.055782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.056224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.072165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:02.073079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:02.080598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.081039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.081814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.082265 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.184109 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.193131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8cd05abe-42c1-4e03-b3e9-a5219e7a4ab9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.150751 Aug 27 03:34:02.193693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 282/585] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:02 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:02.198088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:02.199328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:02.206304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.206819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.207618 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.208044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.353482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fbeb8846-4ede-4967-b035-57081f33d4a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 38407 microversion: 2.1 time: 0.284905 Aug 27 03:34:02.354146 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 304/586] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:02 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 38407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:02.362649 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:02.363345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:02.369173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.369610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.370394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:02.370816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:02.402907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5c790146-fd63-44eb-bb95-8521e8e970e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 6257 microversion: 2.20 time: 0.207870 Aug 27 03:34:02.403492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 283/587] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:02 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 6257 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:02.491763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.499826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9cae81cd-781a-49d8-9a8c-d2ca74d58e8d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.143932 Aug 27 03:34:02.500502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 305/588] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:02 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.212553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.213163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:03.222839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.223291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.224070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.224503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.359635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.366702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:03.367654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:03.368820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a96b5c13-3154-4e7c-9f00-e7643e1fcabc tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.160599 Aug 27 03:34:03.369639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 284/589] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:03 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.373607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.374707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.375664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.376097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.414760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:03.415911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:03.422136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.422583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.423377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.423804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.550172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-62f714ee-acad-4f14-9fa1-70bf7bd472d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 38407 microversion: 2.1 time: 0.186917 Aug 27 03:34:03.551132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 306/590] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:03 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 38407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:34:03.556067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.557031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:03.568003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.568479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.569270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.569693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.609509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3f535350-2055-4b6f-937b-eba8925d7cfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 10235 microversion: 2.20 time: 0.198484 Aug 27 03:34:03.610218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 285/591] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:03 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 10235 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:03.706363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.726236 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7ffbba22-07f4-4e88-a8f6-5e254095b92c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.173522 Aug 27 03:34:03.726764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 307/592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:03 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.892710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.893471 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:03.900438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.900887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:03.901664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:03.902129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.036053 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.044969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-afdeb137-33cb-4991-b05a-0032ad60e697 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1591 microversion: 2.1 time: 0.157520 Aug 27 03:34:04.045808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 286/593] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:03 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1591 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:04.387927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.388589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:04.395644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.396092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.396870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.397328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.541160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.551334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6a43704d-a5b6-407c-8b1d-1850c18e151f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.166989 Aug 27 03:34:04.564504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 308/594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:04 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:04.565095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:04.566352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:04.572523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.572921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.573864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.574504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.625647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:04.627586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:04.635726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.636191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.637009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.637441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.679507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1d398db6-fa1a-4c77-909d-09d3e625ff94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 38407 microversion: 2.1 time: 0.119755 Aug 27 03:34:04.680223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 287/595] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:04 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 38407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:04.745421 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.746224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:04.753970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.754403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.755400 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:04.755851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:04.873180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d8cfaf66-b42a-4d5a-9264-785541300251 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 15064 microversion: 2.20 time: 0.254591 Aug 27 03:34:04.874773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 309/596] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:04 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 15064 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:04.977674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.992338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ae5da3dc-8a46-460c-a40d-e200287d50a0 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.250505 Aug 27 03:34:04.993205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 288/597] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:04 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:05.573115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:05.574092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:05.582537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:05.583021 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:05.583879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:05.584346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:05.693293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:05.694451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:05.701243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:05.701733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:05.703268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:05.703783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:05.720760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.729947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d0fb8c3-2cc5-42b8-a8d5-7cdef055b91c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.161976 Aug 27 03:34:05.741888 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 310/598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:05 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:05.884750 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:05.885310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7390f1b6-5c7b-4f1a-b2dc-78682014b4e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 38500 microversion: 2.1 time: 0.196084 Aug 27 03:34:05.885816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:05.886609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 289/599] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:05 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 38500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:34:05.895437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:05.895885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:05.896653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:05.897082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.011566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.012345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:06.019772 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.020219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.020985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.021419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.028266 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8ef2d429-c070-4e86-bbec-132589a86ce2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 18030 microversion: 2.20 time: 0.147004 Aug 27 03:34:06.032806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 311/600] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:05 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 18030 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:06.151719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.160396 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-551eb05e-17a3-42c0-b1e1-8a6e4cb2c12b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.153242 Aug 27 03:34:06.160993 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 290/601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:06 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:06.365758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-819655c6-e9e1-4297-975e-757a444f95cf req-603ea609-8503-402d-9e3d-19322bde0282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:06.367363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:06.367363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:34:06.377341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-819655c6-e9e1-4297-975e-757a444f95cf req-603ea609-8503-402d-9e3d-19322bde0282 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.377787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-819655c6-e9e1-4297-975e-757a444f95cf req-603ea609-8503-402d-9e3d-19322bde0282 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.390336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-819655c6-e9e1-4297-975e-757a444f95cf req-603ea609-8503-402d-9e3d-19322bde0282 service nova] Creating event network-changed:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:34:06.395469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-819655c6-e9e1-4297-975e-757a444f95cf req-603ea609-8503-402d-9e3d-19322bde0282 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033605 Aug 27 03:34:06.396364 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 312/602] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:06.748682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.749491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:06.756757 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.757195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.758199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.758638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.897799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:06.899646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:06.906545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.908895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.909583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.910854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.911491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.915215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-94556aae-37e3-41be-ab63-9cd9a76ae630 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.170177 Aug 27 03:34:06.921263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 291/603] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:06 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:07.043996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:07.045075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:07.053999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.054649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:07.055534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.056070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:11.920591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c6789bf8-d7b0-4bcc-a900-3495c18de45c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 200 len: 38538 microversion: 2.1 time: 5.027011 Aug 27 03:34:11.921752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 313/604] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:06 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 38538 bytes in 5029 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:34:11.926705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.927402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:11.933844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:11.934341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:11.935118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:11.935550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:11.960027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d3f501e8-ed95-4f6a-b3e2-c1a7e1d5073e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 25400 microversion: 2.20 time: 4.922793 Aug 27 03:34:11.961402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 292/605] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:07 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 25400 bytes in 4925 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:11.972325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-220929260"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:11.973107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:11.979604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:11.980136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:11.980978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:11.981484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.153067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:12.162048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cfddf360-bdfc-45b0-aa66-25f1091054b8 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.239019 Aug 27 03:34:12.170515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 314/606] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:11 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:12.176702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.177452 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:12.185467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.185918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.188268 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.188716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.203650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.network.security_group_api [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Adding security group 20df78b8-f19f-44ca-88d2-32ccf6d6ec47 to port ab86934c-3c7f-4ee5-8361-ae8500899a8b Aug 27 03:34:12.489940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:12.497651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e04caec1-a03e-4682-9420-1ccba2663b19 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.324682 Aug 27 03:34:12.498337 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 315/607] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:12 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:12.503280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.503836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:12.510289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.510732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.511501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.511929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.540620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8c6bf31a-bd54-45de-9f43-efa308b2f600 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/ips" status: 200 len: 146 microversion: 2.1 time: 0.040549 Aug 27 03:34:12.546077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 316/608] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Aug 27 03:34:12 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:12.976868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:12.978582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:12.986108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.986549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.987322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.987746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.028541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be361d27-4ef6-4091-9769-f33b45d393ba tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/action" status: 202 len: 0 microversion: 2.1 time: 1.061253 Aug 27 03:34:13.029559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 293/609] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:11 2021] POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/action => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:13.038209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.038821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:13.049086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.049543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.050370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.050811 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.201014 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.210635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-30814dcd-3cc9-4d87-ba5c-bca2df983532 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 26484 microversion: 2.20 time: 0.239794 Aug 27 03:34:13.213616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 317/610] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:12 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 26484 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:13.213776 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-376dbb61-b35b-44e3-b011-2c430e0c2c9d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1755 microversion: 2.1 time: 0.177300 Aug 27 03:34:13.214370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 294/611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:13 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:13.220223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-19a01700-be7d-4526-891c-913d2359790c req-af0a07af-7555-4958-a932-3012255962bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:13.220502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.221125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:13.222273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:13.222273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:34:13.228691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.228691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.228691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.229044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.231471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-19a01700-be7d-4526-891c-913d2359790c req-af0a07af-7555-4958-a932-3012255962bf service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.232001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-19a01700-be7d-4526-891c-913d2359790c req-af0a07af-7555-4958-a932-3012255962bf service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.244706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-19a01700-be7d-4526-891c-913d2359790c req-af0a07af-7555-4958-a932-3012255962bf service nova] Creating event network-changed:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:34:13.250878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-19a01700-be7d-4526-891c-913d2359790c req-af0a07af-7555-4958-a932-3012255962bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037090 Aug 27 03:34:13.251805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 318/612] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:13.405078 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.412599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3503b41b-6511-4d18-b26f-011b971c0134 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.197008 Aug 27 03:34:13.413447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 295/613] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:13 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.516657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.517464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:13.524084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.524522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.525291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.525717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.717327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.726696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-08ecdcc9-ec64-482c-97f8-310eb35698ef tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.214759 Aug 27 03:34:13.727442 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 319/614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:13 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:14.222968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:14.224110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:14.230527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.231065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.231929 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.232400 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.428737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.429360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:14.435590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.436025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.437995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.438659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.571572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.579791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-07a45407-2e09-46f5-9a98-c9bfcb30f6d7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.154656 Aug 27 03:34:14.580385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 320/615] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:14 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:14.743745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.744381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:14.751597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.752036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.752796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.753223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.864600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fe39e50d-4efa-45ce-8503-656afe1640e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 27144 microversion: 2.20 time: 0.645681 Aug 27 03:34:14.865233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 296/616] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:14 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 27144 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:14.884301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.892912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-502c615b-a823-4ae8-b39a-af8466c46758 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.152845 Aug 27 03:34:14.893479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 321/617] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:14 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:15.598818 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.599534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:15.606458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.606909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.607690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.608123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.743703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.752166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-346979a7-ab21-477a-80a3-fbf14a39357c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.158036 Aug 27 03:34:15.752850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 297/618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:15 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:15.876921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:15.877893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:15.884990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.885819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.885995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-c5efad59-b7bb-4449-aa93-c42e998b16e0 req-7ebf70ce-d0f4-4691-b3aa-77cbc3f9e8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708e412a-5d6c-4e12-af72-0a9bc472dbb7", "name": "network-vif-plugged", "status": "completed", "tag": "f2990968-bc26-42a3-a2a7-59f3828f8ac7"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:15.886826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.887449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.887600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:15.887600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:34:15.895922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c5efad59-b7bb-4449-aa93-c42e998b16e0 req-7ebf70ce-d0f4-4691-b3aa-77cbc3f9e8f5 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.896453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c5efad59-b7bb-4449-aa93-c42e998b16e0 req-7ebf70ce-d0f4-4691-b3aa-77cbc3f9e8f5 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.916007 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-c5efad59-b7bb-4449-aa93-c42e998b16e0 req-7ebf70ce-d0f4-4691-b3aa-77cbc3f9e8f5 service nova] Creating event network-vif-plugged:f2990968-bc26-42a3-a2a7-59f3828f8ac7 for instance 708e412a-5d6c-4e12-af72-0a9bc472dbb7 on hv-cinder-77398 Aug 27 03:34:15.920877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-c5efad59-b7bb-4449-aa93-c42e998b16e0 req-7ebf70ce-d0f4-4691-b3aa-77cbc3f9e8f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038766 Aug 27 03:34:15.922183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 298/619] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:15.927099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.927780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:15.934329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.934773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.935533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.935957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:16.081029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.091907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d0fa95e3-bfb1-42c1-bb35-d2c2f703f861 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.168471 Aug 27 03:34:16.092597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 299/620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:15 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:16.210446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6ab7cd34-78f7-4055-906c-9aa573c5536c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 27694 microversion: 2.20 time: 0.337609 Aug 27 03:34:16.211044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 322/621] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:15 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 27694 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:16.770601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:16.770601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:16.778933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:16.779970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:16.780888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:16.781909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:16.954501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.962581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c50ad5eb-b011-4cd0-8250-788bf1f0e858 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.197631 Aug 27 03:34:16.963170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 300/622] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:16 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:17.110803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.111434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:17.118711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.119150 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.119921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.120344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.224610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:17.225569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:17.232123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.232569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.234034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.234628 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.264818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.275390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7933947b-21f6-4539-a180-b8f00f33fd0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.169527 Aug 27 03:34:17.276108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 323/623] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:17 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:17.797791 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-746d6212-79c6-488f-b10f-a152aa8b2e83 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 27946 microversion: 2.20 time: 0.578038 Aug 27 03:34:17.798915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 301/624] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:17 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 27946 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:17.982367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.983007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:17.990111 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.990561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.991355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.991787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:18.118334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:18.126525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6752e09f-ee84-456d-9059-29b5b028809c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.147766 Aug 27 03:34:18.127129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 324/625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:17 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:18.296030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:18.296816 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:18.304482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:18.305015 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:18.305954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:18.306520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:18.434444 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:18.442311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f9f64143-d43f-42c7-a01b-69b41536ccd1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.151405 Aug 27 03:34:18.442866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 302/626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:18 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:18.784226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc90cf95-d75c-47d2-880b-f58a0c706fe7"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:18.785288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:18.791369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:18.791815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:18.792607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:18.793039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:18.809198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:18.810270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:18.817638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:18.818168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:18.818992 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:18.819498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:19.761310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2137332b-3c55-4b97-9785-33adc5febfde tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 27946 microversion: 2.20 time: 0.956004 Aug 27 03:34:19.761955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 303/627] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:18 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 27946 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:19.767376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:19.768067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:19.774459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:19.774906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:19.775669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:19.776101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:19.916305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.937385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dcae60c4-7448-40dd-bb48-8d8f9ea17196 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.173526 Aug 27 03:34:19.938660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 304/628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:19 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:19.943718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:19.944494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:19.950519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:19.951009 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:19.951921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:19.952580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:19.997677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-37771c5a-77a6-42dc-8c93-c170e0ab2b9a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.217649 Aug 27 03:34:20.004714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 325/629] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:34:18 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-volume_attachments => generated 194 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:20.084770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:20.092963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c28b7d27-f9b5-4358-8f09-05ace9519306 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.153062 Aug 27 03:34:20.094170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 305/630] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:19 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:20.773602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:20.774733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:20.781789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:20.782262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:20.783071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:20.783506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:20.951994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8d06e200-47e1-4834-bbe4-af51629d95b6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28072 microversion: 2.20 time: 0.182441 Aug 27 03:34:20.954138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 326/631] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:20 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28072 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:20.956173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:20.956783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:20.963308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:20.963754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:20.964534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:20.964965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:21.091632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.101387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1b7ad5d4-9a64-4013-b047-87f69f09b40d tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1317 microversion: 2.1 time: 0.149151 Aug 27 03:34:21.111799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 306/632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:20 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:21.112293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.112902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:21.119937 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:21.120640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:21.121536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:21.122040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:21.266192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.274354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7cb5faec-7787-47e7-95fb-87fe507c2408 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.167408 Aug 27 03:34:21.274922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 327/633] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:21 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:21.965226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:21.966201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:21.972648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:21.973102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:21.973869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:21.974332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.119077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.119686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:22.127824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.128562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.129605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.130359 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.196909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a0e31267-3e35-4173-bfb3-faa6f88871bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28190 microversion: 2.20 time: 0.235178 Aug 27 03:34:22.197767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 307/634] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:21 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28190 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:22.204597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1746041406", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-699246540", "security_groups": [{"name": "tempest-secgroup-smoke-1821316026"}], "block_device_mapping_v2": [{"uuid": "79724246-2e53-49cb-9c29-d9f587cfec46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc4f9fa9-5953-43ff-b4f3-e98c9fc78c8d"}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:22.308462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:22.318480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6961eda3-0292-4fc3-809f-b1d6140aab0f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1507 microversion: 2.1 time: 0.203099 Aug 27 03:34:22.319090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 328/635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:22 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:22.323531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.324070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:22.327786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] validate_networks() for [('fc4f9fa9-5953-43ff-b4f3-e98c9fc78c8d', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:34:22.330490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.331026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.332201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.332962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.567220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:22.577069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0c5360c0-2cea-4f88-9a67-b6eabeecdac1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1568 microversion: 2.1 time: 0.256800 Aug 27 03:34:22.578296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 329/636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:22 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:22.788445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:22.788859 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:22.789356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:22.789795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:22.790302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:22.798932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.799373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.800170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.800604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.817082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:22.820948 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for user 6883257742b64642887adffbe4f0a725 and project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:22.881677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:34:22.884016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79724246-2e53-49cb-9c29-d9f587cfec46',volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:34:23.044328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2eee4747-2118-4120-968d-7203eb6942fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844756 Aug 27 03:34:23.045313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 308/637] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:34:22 2021] POST /compute/v2.1/servers => generated 406 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:34:23.055231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bea4235c-bf00-4aa8-91c0-c608737cf23a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:23.055845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bea4235c-bf00-4aa8-91c0-c608737cf23a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:23.110666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bea4235c-bf00-4aa8-91c0-c608737cf23a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.121011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bea4235c-bf00-4aa8-91c0-c608737cf23a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1094 microversion: 2.1 time: 0.069437 Aug 27 03:34:23.121626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 330/638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:23 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:23.209412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:23.210857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:23.218523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.218966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.219969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.220544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.329717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-24b78b31-ea42-4f80-92e7-5fe04cca5f7b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.123601 Aug 27 03:34:23.330784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 309/639] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:23 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:23.595015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:23.595641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:23.601620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.602087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.602921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.603290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.743102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.750935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-669fa705-db4c-4341-b3d8-31f114befe9a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1548 microversion: 2.1 time: 0.160360 Aug 27 03:34:23.751502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 331/640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:23 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:23.768070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:23.768644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:23.775058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.775504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.776260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.776689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.866115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] HTTP exception thrown: Cannot 'detach_volume' instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c while it is in vm_state rescued Aug 27 03:34:23.866949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Returning 409 to user: Cannot 'detach_volume' instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c while it is in vm_state rescued {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:34:23.868321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9eaae834-af51-4d03-8d46-6db5ddbc482c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "DELETE /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments/02d70aa2-1e40-4f9b-97aa-445060457977" status: 409 len: 152 microversion: 2.1 time: 0.104808 Aug 27 03:34:23.869244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 310/641] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:34:23 2021] DELETE /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments/02d70aa2-1e40-4f9b-97aa-445060457977 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:34:23.879972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:23.880500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:23.886668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.887087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.887880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.888316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.959163 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-51307620-3ce3-4395-b790-9f727deabacd tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action" status: 202 len: 0 microversion: 2.1 time: 0.082976 Aug 27 03:34:23.959800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 332/642] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:23 2021] POST /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:23.968533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:23.969175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:23.975427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.975891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.976665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.977095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.154338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.155912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:24.167640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.168963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.169673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.170501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.171660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.177136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-27f6f2ce-96d5-48f1-ab8f-aeb40a6fb772 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.212954 Aug 27 03:34:24.177972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 311/643] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:23 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:24.282658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.292091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-44a2ac18-df38-4d57-90d5-8fcfb1890400 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1200 microversion: 2.1 time: 0.156110 Aug 27 03:34:24.292678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 333/644] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:24 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1200 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:24.345697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:24.346805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:24.357923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.359442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.360512 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.361239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.476230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cf40e87d-1a06-423c-82f9-c0eb411ca89f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.135819 Aug 27 03:34:24.478002 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 312/645] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:24 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:24.790784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b1fc49e-c746-462f-8278-7dd1549fc515"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:24.792595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:24.799675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.800140 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.800905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.801332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.107254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4d95282d-5f58-4655-b2e5-dd4d2954a4e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "POST /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320300 Aug 27 03:34:25.108045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 334/646] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:34:24 2021] POST /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:25.196066 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.196892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:25.206758 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.207196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.207994 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.208420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.313254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.313946 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:25.321124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.321846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.322936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.323551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.367512 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.379076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-87ada252-46cf-47e7-8dbc-e8cc09b451e7 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.186836 Aug 27 03:34:25.390196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 313/647] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:25 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:25.470148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.478431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ffd22c94-38b3-40d0-891d-32326e569210 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.170584 Aug 27 03:34:25.479012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 335/648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:25 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:25.491245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:25.492291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:25.499537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.500099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.500896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.501326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.632246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-35b57b0f-277a-4aa8-bb16-251b32da98bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.144933 Aug 27 03:34:25.632908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 314/649] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:25 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:25.975655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-ca6e5282-9ae3-40be-bf96-dd198bc8dbeb req-e121cac0-881f-4339-b693-ae15c1b61c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259f7cfe-9ee5-44ec-b227-d524587c5600", "tag": "12277069-4498-4469-9aee-a13eb400f6d3"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:25.977309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:25.977309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:34:25.998397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ca6e5282-9ae3-40be-bf96-dd198bc8dbeb req-e121cac0-881f-4339-b693-ae15c1b61c35 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.999374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ca6e5282-9ae3-40be-bf96-dd198bc8dbeb req-e121cac0-881f-4339-b693-ae15c1b61c35 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.015954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-ca6e5282-9ae3-40be-bf96-dd198bc8dbeb req-e121cac0-881f-4339-b693-ae15c1b61c35 service nova] Creating event network-changed:12277069-4498-4469-9aee-a13eb400f6d3 for instance 259f7cfe-9ee5-44ec-b227-d524587c5600 on hv-cinder-77398 Aug 27 03:34:26.021193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-ca6e5282-9ae3-40be-bf96-dd198bc8dbeb req-e121cac0-881f-4339-b693-ae15c1b61c35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049589 Aug 27 03:34:26.021825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 336/650] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:26.396022 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.396738 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:26.403255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.403692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.404442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.404865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.497342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.498050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:26.504667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.505149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.505916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.506486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.540575 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.549668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9e838709-236e-4aa1-96cc-3ed1f4817b0a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.157607 Aug 27 03:34:26.550472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 315/651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:26 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:26.637787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.645032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:26.645908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0662d9bb-0e83-4d9e-be61-bb562546913c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.152849 Aug 27 03:34:26.646304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:26.646504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 337/652] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:26 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:26.652327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.652861 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.653771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.654226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.570839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.571453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:27.577772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.578252 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.579021 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.579446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.712047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.720315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8b0b8dd8-6c8e-4fb9-a570-9cab2eb30e0d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.153090 Aug 27 03:34:27.720890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 338/653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:27 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:27.725161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.725767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:27.731732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.732179 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.732953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.733385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.853133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.860907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e4feca2c-ce58-40c4-a489-ebcdc3848a1b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.139055 Aug 27 03:34:27.861467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 339/654] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:27 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:28.738703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:28.739377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:28.745516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:28.745952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:28.746744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:28.747171 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:28.874304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:28.882250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1c799401-0e08-4d7c-a8b6-b82ec215075e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.148700 Aug 27 03:34:28.882841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 340/655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:28 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:28.887243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:28.887852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:28.895312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:28.895312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:28.895620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:28.895877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:29.021812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.029115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bb880785-8388-4386-b0a9-f8ca498ab886 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.145323 Aug 27 03:34:29.029874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 341/656] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:28 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:29.899401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:29.900014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:29.905836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:29.906862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:29.907634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:29.908072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:30.038485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.048013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4157d9a8-b88d-40e4-94c5-fd26e860dd9c tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.152183 Aug 27 03:34:30.048591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 342/657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:29 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:30.053096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:30.053877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:30.060065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:30.060496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:30.061441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:30.061899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:30.188308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.195651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fe24b984-24c0-4c52-95b2-c86776195ad3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.146084 Aug 27 03:34:30.196436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 343/658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:30 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:30.223592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9148624c-f7d3-4f5a-9f4b-684932e75f8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 3.582841 Aug 27 03:34:30.224498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 316/659] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:26 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 3585 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:31.064618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.065238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:31.071094 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.071534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.072322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.072748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.198639 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:31.207315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-65a6fb95-8626-4c53-bfeb-32e685c7f0c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.146559 Aug 27 03:34:31.207976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 344/660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:31 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:31.213108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.213797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:31.220919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.221364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.222163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.222592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.235748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:31.236723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:31.244846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.245576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.246903 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.247627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.354495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:31.362361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c320d938-9900-4201-bc70-1ea10fbd1edc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.153153 Aug 27 03:34:31.362928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 317/661] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:31 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:31.381836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d0d300c5-23a5-4ba6-abf8-182610edfc6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.150308 Aug 27 03:34:31.382523 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 345/662] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:31 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:31.835503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3b5385f4-89bb-4f13-9452-950d59a580ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:31.841440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b5385f4-89bb-4f13-9452-950d59a580ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.841879 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b5385f4-89bb-4f13-9452-950d59a580ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.904082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3b5385f4-89bb-4f13-9452-950d59a580ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Going to try to stop instance {{(pid=109037) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 03:34:31.953920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3b5385f4-89bb-4f13-9452-950d59a580ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 202 len: 0 microversion: 2.1 time: 0.115520 Aug 27 03:34:31.953920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 318/663] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:31 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:31.960939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.961638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:31.969198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.969965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.971582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.972467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.103369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.112243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2b7ddb96-1ad8-4fa5-a2c1-41e8664c7593 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.156100 Aug 27 03:34:32.113291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 346/664] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:31 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:32.225043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:32.225730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:32.232325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:32.232763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.233561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:32.234603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.383185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:32.383941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:32.393044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:32.393734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.394676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:32.395203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.400851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.409751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-84334966-309a-4503-9736-e087c3dc8422 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1556 microversion: 2.1 time: 0.188591 Aug 27 03:34:32.410850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 319/665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:32 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:32.417189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:32.418253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:32.425312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:32.425836 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.426719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:32.427233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.529461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.539375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f1e444c8-80c8-4a3b-a41a-3cd6e01304f1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1278 microversion: 2.1 time: 0.162168 Aug 27 03:34:32.540215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 347/666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:32 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:32.584035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-97778195-7bdf-46e7-95bb-c78832a5509d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.171562 Aug 27 03:34:32.584675 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 320/667] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:32 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:33.130121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.130668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:33.137527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.137974 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.138775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.139211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.273483 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.288095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f4c49b9a-21d0-46be-8536-986c33d54da9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.161358 Aug 27 03:34:33.289104 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 348/668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:33 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:33.428311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.429011 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:33.435520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.435974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.441901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.441901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.559009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.559824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:33.566764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.567207 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.575122 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.576195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.576771 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.584734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-35add190-7906-4f5d-a647-8ce30fcd592e tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1562 microversion: 2.1 time: 0.160422 Aug 27 03:34:33.585564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 321/669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:33 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:33.607209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:33.608506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:33.617086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.617576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.618384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.618881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.726415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.733998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fa8123a3-609e-401e-a91a-08d25e4c4ac6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.180710 Aug 27 03:34:33.743758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 349/670] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:33 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:33.743758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.743758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:33.745458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.745906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.746711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.747161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.888911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lazy-loading 'services' on Instance uuid 248b6ca4-52d6-42f2-8ab8-823ee2872a2c {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:34:33.945810 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-36432401-cfab-4711-9d01-5f340ea15670 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.344573 Aug 27 03:34:33.946397 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 322/671] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:33 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:34.001465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-344a4519-6b3b-4507-970a-00683e6dd207 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "DELETE /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments/02d70aa2-1e40-4f9b-97aa-445060457977" status: 202 len: 0 microversion: 2.1 time: 0.264013 Aug 27 03:34:34.002100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 350/672] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:34:33 2021] DELETE /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments/02d70aa2-1e40-4f9b-97aa-445060457977 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:34.011622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:34.012677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:34.020988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.022198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.022984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.023605 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.055852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a52ec600-3577-4e69-b219-c6c312fbb966 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048561 Aug 27 03:34:34.056412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 323/673] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:34 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:34.311631 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:34.312320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:34.320405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.321685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.322482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.322907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.450939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:34.459025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8f268e4d-ac21-43e7-8dcc-5163922b931c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.152143 Aug 27 03:34:34.459639 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 351/674] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:34 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:34.752012 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:34.752630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:34.758699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.759147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.759932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.760368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.880564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:34.887663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-71cc19a1-cd66-4ad4-8390-0415362abfe5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.140391 Aug 27 03:34:34.888231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 324/675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:34 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:34.958074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:34.959074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:34.964838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.965288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.966113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.966549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.068241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:35.069141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:35.075742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.076324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.077090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.077595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.094460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a3b8532f-b0f6-4c16-a841-f93b910f2be5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.141009 Aug 27 03:34:35.095011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 352/676] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:34 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:35.108553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-16545300-c37d-4480-8a97-80c87a6eae1f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Aug 27 03:34:35.109938 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 325/677] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:35 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:35.475751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:35.476482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:35.482963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.483415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.484793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.485317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.621156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:35.629933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8f4f3687-1a36-4dc4-98aa-a5ab1fca5a89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.158226 Aug 27 03:34:35.630541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 353/678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:35 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:35.904751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:35.905634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:35.912697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.913142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.913925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.914394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.043497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:36.051357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee25781a-54a1-4a86-b605-37a67791e43c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.150278 Aug 27 03:34:36.051928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 326/679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:35 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:36.106949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:36.107897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:36.114780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:36.115594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.116571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:36.117010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.122664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:36.123716 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:36.131002 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:36.131741 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.132687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:36.133191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.164347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d701dc11-8209-4985-980c-7a6912de1be3 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Aug 27 03:34:36.165056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 327/680] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:36 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:36.243851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6e5b5149-2023-401b-bcec-767e72a1e6d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.140291 Aug 27 03:34:36.244748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 354/681] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:36 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:36.684058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:36.684663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:36.690854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:36.691331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.692123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:36.692552 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:36.839944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:36.852669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a0effc49-d517-46e7-9730-dc581df2a12a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.171595 Aug 27 03:34:36.877279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 328/682] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:36 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:37.069566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:37.070304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:37.080522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.081064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.081910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.082391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.176212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:37.177186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:37.183319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.183764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.184520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.184951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.220634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9eef1200-6431-4403-8c61-f0de48607909 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048018 Aug 27 03:34:37.221283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 329/683] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:37 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:37.231908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:37.240555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-321fd162-e2de-4719-a9f3-58baf827859f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.174985 Aug 27 03:34:37.241253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 355/684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:37 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:37.256217 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:37.257138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:37.263442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.263892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.264667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.265376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.405054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-48dc9680-612f-40b1-bee8-c205d5cd20e3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.152364 Aug 27 03:34:37.406443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 330/685] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:37 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:37.884197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:37.884813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:37.890653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.891204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.891899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:37.892327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.027874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:38.042964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-deb81fb7-af1c-48b7-b878-59ac9dd0e0b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.156091 Aug 27 03:34:38.042964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 356/686] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:37 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:38.232652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:38.233656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:38.240439 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.240889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.241660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.242145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.257912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:38.258556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:38.264774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.265768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.266752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.267182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.273324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c5e9980c-7248-4766-90f3-500939690c51 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Aug 27 03:34:38.274321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 331/687] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:38 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:38.411664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:38.419232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:38.420149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:38.421298 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c41d9171-7474-4ffd-b3c7-f0ff9bd422fc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.166741 Aug 27 03:34:38.422965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 357/688] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:38 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:38.427033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.427478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.428253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.428676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.578997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f8bc1580-4002-4363-b41c-5c8e12e47896 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.153316 Aug 27 03:34:38.589731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 332/689] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:38 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:39.053579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:39.054368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:39.061308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.061803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.063298 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.063728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.188572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.196249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1ea347be-195b-453f-9ece-2939f42325a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.146922 Aug 27 03:34:39.196799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 358/690] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:39 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:39.285275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:39.286306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:39.292531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.292981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.293752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.294236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.325325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9abbaa84-4bba-45c2-9cf8-31123ad6b37a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Aug 27 03:34:39.326110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 333/691] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:39 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:39.440517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:39.441046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:39.447026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.447459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.448220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.448642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.575130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.582910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2c30f8dd-af12-4779-878f-b0810abbfda4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.147189 Aug 27 03:34:39.583469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 359/692] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:39 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:39.592753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:39.593911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:39.600134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.600655 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.601506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:39.601957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:39.751618 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e7159218-254a-423d-ab99-6f6eaf97d83c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.162443 Aug 27 03:34:39.752479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 334/693] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:39 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:40.223240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.223768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.224853 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.225621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.229684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.230162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.230995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.231468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.232420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.232872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.234278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.235584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.325352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'services' on Instance uuid 708e412a-5d6c-4e12-af72-0a9bc472dbb7 {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:34:40.369170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:40.380277 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1339cdf8-58c6-406d-8184-dedca7379c22 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.160671 Aug 27 03:34:40.381022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 360/694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:40 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:40.395912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.396870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.399166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e2f2f989-d264-4b2e-81d0-21b993d04ab7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments/1b1fc49e-c746-462f-8278-7dd1549fc515" status: 202 len: 0 microversion: 2.1 time: 0.178155 Aug 27 03:34:40.399772 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 335/695] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:34:40 2021] DELETE /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments/1b1fc49e-c746-462f-8278-7dd1549fc515 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:40.403178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.403743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.404522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.404954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.410784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.412079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.418392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.419010 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.419813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.420292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.437159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1b677898-6f65-4ec4-abaf-7f04e531d424 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Aug 27 03:34:40.438099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 361/696] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:40 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:40.450590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-731b04c9-6a0d-4fa9-b702-0c01d48bdd62 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Aug 27 03:34:40.451161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 336/697] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:40 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:40.599621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.600230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.606297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.606740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.607506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.607934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.733205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:40.740773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bf4a0776-ba73-4a7a-8214-60f7d5471077 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.144720 Aug 27 03:34:40.741342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 362/698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:40 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:40.763405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:40.764276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.771285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.771732 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.772501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.772932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.878464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-586c4f3e-8b92-4fc6-8680-2275edbcbe9b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.118581 Aug 27 03:34:40.879135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 337/699] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:40 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:41.397638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.398550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:41.404870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.405315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.406712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.407139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.449713 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.451391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:41.461270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.461434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.462446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.463046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.496479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f2cfafa2-3903-4213-9d69-9db8d1dad1e9 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051183 Aug 27 03:34:41.497043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 338/700] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:41 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:34:41.505049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.506203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:41.512186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.512630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.513433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.513855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.563795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee864fd6-8bc0-4688-a933-5f1e5bc000ab tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065681 Aug 27 03:34:41.564382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 339/701] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:41 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:41.589359 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:41.604281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c1d2f007-0432-4b39-94d4-b82e4e7fb9d4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.210102 Aug 27 03:34:41.605708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 363/702] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:41 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:41.759087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.759627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:41.766439 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.766896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.767661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.768104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.891281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:41.891456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:41.892597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:41.898377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.898718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-85b1732f-2135-4b43-8723-cd850b1358e6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.143348 Aug 27 03:34:41.898844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.899484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 340/703] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:41 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:41.899692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.900533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.020549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e8c64ad4-02c3-487f-828a-0410107ed66e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.133399 Aug 27 03:34:42.021165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 364/704] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:41 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:42.576614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:42.577697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:42.584431 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.584880 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.585662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.586222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.618380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a351e308-e8f4-4ae9-83bd-750b70e18518 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046691 Aug 27 03:34:42.618861 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 341/705] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:42 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:42.625101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:42.625899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:42.633199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.633852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.634769 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.635507 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.773525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:42.782086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-48dc467f-7a58-4d8e-8935-a469f7f01151 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.162038 Aug 27 03:34:42.782672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 365/706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:42 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:42.917271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:42.917781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:42.925171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.925804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.926621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.927078 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.033906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:43.035222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:43.041351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.041812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.042586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.043007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.056710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:43.064780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-49c5e84c-f5a6-4cd4-adcd-6f81560a34b0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.152024 Aug 27 03:34:43.065670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 342/707] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:42 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:43.173064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2cd5d4f5-7d69-46cf-b262-be362c4aef96 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.142692 Aug 27 03:34:43.173627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 366/708] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:43 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:43.631391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.632155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:43.638243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.638695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.639478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.639937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.670044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f548c539-e4ee-4ec3-a1a4-9cec299d4dc4 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042927 Aug 27 03:34:43.670944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 343/709] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:34:43 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:34:43.801668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.802621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:43.809717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.810260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.811037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.811466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.863925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.864607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:43.872855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.873514 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.874966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.875145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.908063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:34:43.996764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.007506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-096a0473-955b-48a0-b163-231a7b5fbbc4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.211688 Aug 27 03:34:44.007706 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8069eb86-14b1-4723-a076-69ef5bd94999 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 204 len: 0 microversion: 2.1 time: 0.150062 Aug 27 03:34:44.008178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 344/710] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:34:43 2021] DELETE /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:44.010616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 367/711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:43 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:44.016859 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.017766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:44.024666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.025116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.025881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.026351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.083158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.083789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:44.089990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.090493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.091263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.091683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.183073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.191051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a3ecb222-8b12-4368-b485-6ff5a11cd98b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.178539 Aug 27 03:34:44.191996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 345/712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:44 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:44.196905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:44.197858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:44.204725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.205167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.205942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.206430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.247638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.255071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-12a5a889-19f0-452c-879f-19e5529ef0bf tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.175592 Aug 27 03:34:44.255623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 368/713] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:44 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:44.334172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ea80aed5-1d12-4a08-9c58-74462489f966 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.140687 Aug 27 03:34:44.334839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 346/714] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:44 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:44.895942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.896463 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:44.902833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.903273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.904033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.904457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.930391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:34:45.014332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-77e5f05b-b251-43ed-bebb-e25f82ef9f99 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 204 len: 0 microversion: 2.1 time: 0.121600 Aug 27 03:34:45.015002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 369/715] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:34:44 2021] DELETE /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:45.024150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.024850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.027181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.027880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.032005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.032533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.033398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.033829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.034640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.035092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.035858 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.036372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.217916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.221313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.225478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5cae29a4-757d-46a8-97d1-afbbeefcd1fc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.205603 Aug 27 03:34:45.226081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 347/716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:45 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:45.230367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.230971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.233893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ec7ca013-c111-47e5-b818-5f46a13802be tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.210536 Aug 27 03:34:45.235068 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 370/717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:45 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:45.240530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.240530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.241721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.242211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.272270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.272894 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.279110 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.279567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.280437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.280908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.417252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.427201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-380f2279-3462-43ca-9875-bc0ec5ec0d13 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.200063 Aug 27 03:34:45.427911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 348/718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:45 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:45.440484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:45.441409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.447037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.447425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.447877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.449057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.449057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.455490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d180bc08-b9d0-425f-a29f-bbfe6ce6dd14 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.187114 Aug 27 03:34:45.456071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 371/719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:45 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:45.581583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0f91f4e2-c466-4339-a133-3d7498e04ac6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.145503 Aug 27 03:34:45.582391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 349/720] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:45 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:46.242264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.242954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.251571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.251571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.257319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.258138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.261709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.265365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.270652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.271293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.272082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.272516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.499464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:46.507739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:46.510109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b1eadaa4-528c-4bba-b55f-b257109816ef tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.271162 Aug 27 03:34:46.510811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 372/721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:46 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.515127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.515998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.516793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-314134f6-e8fb-4495-9141-2a5beafb2006 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.263577 Aug 27 03:34:46.517351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 350/722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:46 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.521873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-9673f767-108c-40e3-b021-a61a16ec0982 req-30431ee1-c0b6-4cdd-a319-6bd38cd770bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259f7cfe-9ee5-44ec-b227-d524587c5600", "name": "network-vif-plugged", "status": "completed", "tag": "12277069-4498-4469-9aee-a13eb400f6d3"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:46.523664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:46.523664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:34:46.526756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.528841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.529698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.530170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.530390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-9673f767-108c-40e3-b021-a61a16ec0982 req-30431ee1-c0b6-4cdd-a319-6bd38cd770bc service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.531034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-9673f767-108c-40e3-b021-a61a16ec0982 req-30431ee1-c0b6-4cdd-a319-6bd38cd770bc service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.542364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-9673f767-108c-40e3-b021-a61a16ec0982 req-30431ee1-c0b6-4cdd-a319-6bd38cd770bc service nova] Creating event network-vif-plugged:12277069-4498-4469-9aee-a13eb400f6d3 for instance 259f7cfe-9ee5-44ec-b227-d524587c5600 on hv-cinder-77398 Aug 27 03:34:46.548158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-9673f767-108c-40e3-b021-a61a16ec0982 req-30431ee1-c0b6-4cdd-a319-6bd38cd770bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 Aug 27 03:34:46.548751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 351/723] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:46.558523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.559216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.566246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.566694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.567458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.567889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.695853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:46.704975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6aa22ac8-2261-426b-b19d-da46bf38c8e4 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.193096 Aug 27 03:34:46.705570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 373/724] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:46 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.710094 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:46.711063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.716790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.717224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.717981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.718975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.738355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:46.746147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1f43f6c1-fba3-475d-82a9-748b21550831 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.195319 Aug 27 03:34:46.746836 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 352/725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:46 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.848438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-be6ff321-cec0-444e-b127-b99db9c19335 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.141596 Aug 27 03:34:46.849329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 374/726] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:46 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:47.526971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:47.527617 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:47.534353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:47.534898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.534898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.535148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:47.535547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.535978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.541423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.541860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.542638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.543064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.941780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.946501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.948997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5c37a70a-48d0-4a66-81c5-8469d3102c6a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.425625 Aug 27 03:34:47.949568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 353/727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:47 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:47.954236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:47.954829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:47.959221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9f169be8-162f-477c-8fb5-f4a0f8f1ade4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.429336 Aug 27 03:34:47.959791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 375/728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:47 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:47.960301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.960744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.961494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.961914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.964115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:47.965049 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:47.972407 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.972863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.973639 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.974100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.143978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.146357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.151147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cebfd0f3-a504-4f9f-9004-51bcef0c2235 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.200613 Aug 27 03:34:48.151711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 354/729] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:47 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:48.153432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-11380b05-f031-4638-84ea-7e3be8cc81d0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.192689 Aug 27 03:34:48.154174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 376/730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:47 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:48.156017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:48.156971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:48.162613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.163046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.163799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.164268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.966859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:48.967473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:48.975055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.975546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.976377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.976827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.098911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.106370 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9065b50a-b57b-4a1b-a375-2e4574418cdc tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.143112 Aug 27 03:34:49.106943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 377/731] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:48 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:49.111698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:49.112308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:49.118050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.118495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.119261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.119696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.251397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.261935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2f8dd970-7f48-4a31-a41e-848b1856673c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.154002 Aug 27 03:34:49.262537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 378/732] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:49 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:49.267584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:49.268191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:49.273892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.274376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.275150 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.275587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.407380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.414626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-98ceeaa8-c92c-407e-9a95-a920de17367d tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.151146 Aug 27 03:34:49.415199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 379/733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:49 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:49.419389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:49.419991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:49.426330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.426769 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.427554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.427977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.549271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.556630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6830b8dd-3227-4403-a408-12cbe2945022 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.140456 Aug 27 03:34:49.557186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 380/734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:49 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:50.124046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.125339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.131116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.131558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.132315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.132742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.254957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.262067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-02f62b4e-9166-4ab9-abba-89995a3c6405 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.141659 Aug 27 03:34:50.262627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 381/735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:50 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:50.278270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.278867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.284990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.285423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.286202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.286628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.419219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.429389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e7316ef1-fa97-49a7-a9d7-c6875be75a6c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.154397 Aug 27 03:34:50.429961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 382/736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:50 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:50.434405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.435005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.441158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.441600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.442396 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.442838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.576306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.584151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c5385510-6685-4b11-baf0-21bf58f3d2c0 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.153220 Aug 27 03:34:50.584713 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 383/737] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:50 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:50.588860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.589459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.595487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.595928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.596688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.597127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.719131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.728301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-840fbbed-0721-40a9-bf36-5049a2eab535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.142644 Aug 27 03:34:50.728873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 384/738] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:50 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:51.278999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.279680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:51.285760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.286233 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.286991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.287417 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.413009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.420388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6155e248-6063-477c-90c0-9f0c902da399 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.144982 Aug 27 03:34:51.420947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 385/739] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:51 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:51.446819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.447418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:51.453578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.454035 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.454780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.455201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.585454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.595759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0fa38e0f-b30b-430f-abcd-39c2c785e441 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.152145 Aug 27 03:34:51.596303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 386/740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:51 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:51.600583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.601182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:51.607100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.607529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.608299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.608739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.728198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.735889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7f20ca99-d75b-47a5-a133-4b59c9fdd6d6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.138644 Aug 27 03:34:51.736463 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 387/741] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:51 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:51.745406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.746005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:51.752558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.753024 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.753779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.754243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.880804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.888040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-740443da-eae8-4b7f-a5e8-a3e1ee17bde0 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.146077 Aug 27 03:34:51.888606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 388/742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:51 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:52.114892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-95c35f78-4ac7-43dc-8d2a-0639d605948d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 3.961851 Aug 27 03:34:52.115446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 355/743] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:48 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 3963 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:52.439349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.439941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:52.447072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.447547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.448451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.449144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.582786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:52.591751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f3fdad1a-f84b-4c36-ac69-dcdb13678b3f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.157916 Aug 27 03:34:52.592451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 389/744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:52 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:52.614770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.615805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:52.623152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.623824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.625632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.626148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.753454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.754210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:52.755374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:52.760302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.760748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.761526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.761965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.763013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be665272-2024-4d81-91b6-cb186df4010e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1725 microversion: 2.1 time: 0.153949 Aug 27 03:34:52.763709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 356/745] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:52 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:52.891990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:52.901078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d6eab0a2-2b9c-47c9-a184-b7de12c9015a tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.152143 Aug 27 03:34:52.901815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 390/746] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:52 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:52.906984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.907691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:52.914736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.914736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.915523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.915918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.047296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.055035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8b0d79fa-d263-43f2-8669-6bb3e5961692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.154232 Aug 27 03:34:53.055621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 357/747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:52 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:53.127345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.128335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.134266 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.134713 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.135476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.135907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.278284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9650b955-68f8-48bf-804f-73250d94e933 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.154972 Aug 27 03:34:53.278884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 391/748] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:53 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:53.611463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.612073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.618075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.618524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.619290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.619722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.749219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.756954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0c2755a8-a4fd-43f3-9198-ea228cfdcd65 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1513 microversion: 2.1 time: 0.150199 Aug 27 03:34:53.757530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 358/749] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:53 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.780851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.782470 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.789038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.789481 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.790296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.790728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.918868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.919519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.933774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.934410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.934672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.935564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.935846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.944649 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0861e370-ec74-48c9-a4c9-f54a3f37efce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1702 microversion: 2.1 time: 0.167725 Aug 27 03:34:53.945630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 392/750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:53 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1702 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.966546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74014aec-1b00-41ea-ba2a-e1e0f51556c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.982378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74014aec-1b00-41ea-ba2a-e1e0f51556c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.983178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74014aec-1b00-41ea-ba2a-e1e0f51556c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.052824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74014aec-1b00-41ea-ba2a-e1e0f51556c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Going to try to start instance {{(pid=109036) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 03:34:54.082863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.090662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-22717674-e1cc-4a31-a31d-a575dfd64a15 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1507 microversion: 2.1 time: 0.176735 Aug 27 03:34:54.096805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 359/751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:53 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:54.105241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.106398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.113326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.114282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.115182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.115740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.131658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74014aec-1b00-41ea-ba2a-e1e0f51556c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 202 len: 0 microversion: 2.1 time: 0.169606 Aug 27 03:34:54.135653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 393/752] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:53 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:54.141643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.142410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.148752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.149148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.149937 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.150631 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.591413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.595450 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.599524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a3c519f9-c48b-4df4-b033-c9186b81f533 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1266 microversion: 2.1 time: 0.501197 Aug 27 03:34:54.600092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 360/753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:54 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:54.606121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:54.608206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.616829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.617665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c3e4d1eb-3423-49b0-b88c-a559c416014a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1711 microversion: 2.1 time: 0.480582 Aug 27 03:34:54.618723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 394/754] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:54 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1711 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:54.619212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.620383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.621020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.624334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-84ffdd43-5f14-47a0-a3ec-db3347d9245e req-c495074d-dfa3-427a-80fa-3e2f85b51527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708e412a-5d6c-4e12-af72-0a9bc472dbb7", "name": "network-vif-deleted", "tag": "f2990968-bc26-42a3-a2a7-59f3828f8ac7"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:54.628010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:54.628010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:34:54.635751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-84ffdd43-5f14-47a0-a3ec-db3347d9245e req-c495074d-dfa3-427a-80fa-3e2f85b51527 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.636283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-84ffdd43-5f14-47a0-a3ec-db3347d9245e req-c495074d-dfa3-427a-80fa-3e2f85b51527 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.662737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-84ffdd43-5f14-47a0-a3ec-db3347d9245e req-c495074d-dfa3-427a-80fa-3e2f85b51527 service nova] Creating event network-vif-deleted:f2990968-bc26-42a3-a2a7-59f3828f8ac7 for instance 708e412a-5d6c-4e12-af72-0a9bc472dbb7 on hv-cinder-77398 Aug 27 03:34:54.671645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-84ffdd43-5f14-47a0-a3ec-db3347d9245e req-c495074d-dfa3-427a-80fa-3e2f85b51527 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051017 Aug 27 03:34:54.673210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 395/755] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:54.775461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.776445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.782544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eba55b2a-9a21-4d99-8100-6478939e56de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28307 microversion: 2.20 time: 0.181165 Aug 27 03:34:54.783430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 361/756] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:54 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:54.791680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.792260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.792893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.793322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.828344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.828788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.829521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'fault' on Instance uuid 708e412a-5d6c-4e12-af72-0a9bc472dbb7 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:34:54.920092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.928879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d2fefd8a-6883-4f47-a8e1-1778917b3ba3 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 200 len: 1307 microversion: 2.1 time: 0.157233 Aug 27 03:34:54.929378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 396/757] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:54 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:55.108156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.109015 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.115755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.116199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.117004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.117439 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.252522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.260409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-06f59300-e352-40b4-94b1-5c53421c868b tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1465 microversion: 2.1 time: 0.156156 Aug 27 03:34:55.260996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 362/758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.325215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-d4ffdb6b-5231-4abf-ad4e-aa579e5bfb2d req-87df4eb2-367e-4cae-8b6a-3650df7c7cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef870f4c-a749-484d-a466-9be119c21dbf", "name": "network-vif-deleted", "tag": "212f95d8-459a-4da3-a611-d44a86cc8028"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:55.326850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:55.326850 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:34:55.341012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-d4ffdb6b-5231-4abf-ad4e-aa579e5bfb2d req-87df4eb2-367e-4cae-8b6a-3650df7c7cd4 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.341456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-d4ffdb6b-5231-4abf-ad4e-aa579e5bfb2d req-87df4eb2-367e-4cae-8b6a-3650df7c7cd4 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.365735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-d4ffdb6b-5231-4abf-ad4e-aa579e5bfb2d req-87df4eb2-367e-4cae-8b6a-3650df7c7cd4 service nova] Creating event network-vif-deleted:212f95d8-459a-4da3-a611-d44a86cc8028 for instance ef870f4c-a749-484d-a466-9be119c21dbf on hv-cinder-77398 Aug 27 03:34:55.370616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-d4ffdb6b-5231-4abf-ad4e-aa579e5bfb2d req-87df4eb2-367e-4cae-8b6a-3650df7c7cd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060756 Aug 27 03:34:55.371210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 397/759] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:55.617988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.618657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.626249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.626712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.627505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.627944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.635833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.636920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.644097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.644545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.645315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.645742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.818042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.822908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.825501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-89e47530-4fe6-4e6f-9dc1-7131cb4d1f93 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1452 microversion: 2.1 time: 0.211228 Aug 27 03:34:55.826456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 363/760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.830919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:55.831067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-716b85fe-7dd4-45bc-b0ba-d69c452d9f3b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1711 microversion: 2.1 time: 0.199289 Aug 27 03:34:55.831561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 398/761] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1711 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:55.831865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.837541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.838236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.839000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.839427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.840929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.841528 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.847852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.848287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.849040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.849475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.973095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.980382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d8b8c7b6-18f5-4b26-bc34-848b6d1c6628 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1452 microversion: 2.1 time: 0.142918 Aug 27 03:34:55.980951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 399/762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:55.986629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.987272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 708e412a-5d6c-4e12-af72-0a9bc472dbb7] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.994083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.994890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.995698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.996127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:56.011742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] HTTP exception thrown: Instance 708e412a-5d6c-4e12-af72-0a9bc472dbb7 could not be found. Aug 27 03:34:56.012517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Returning 404 to user: Instance 708e412a-5d6c-4e12-af72-0a9bc472dbb7 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:34:56.013565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-99eb5d23-eed9-44ca-9f83-29936cbe663c tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7" status: 404 len: 111 microversion: 2.1 time: 0.031713 Aug 27 03:34:56.014136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 400/763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/708e412a-5d6c-4e12-af72-0a9bc472dbb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:56.176643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fdbb26b5-b09a-48aa-a1c0-2fdc1764b057 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28339 microversion: 2.20 time: 0.348867 Aug 27 03:34:56.180670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 364/764] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:55 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:56.280634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.281252 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:56.287244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.287694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:56.288473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.288908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:56.345519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.346321 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:56.347055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lazy-loading 'fault' on Instance uuid ef870f4c-a749-484d-a466-9be119c21dbf {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:34:56.425195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:56.432474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ad8193ae-f3b9-4102-a24b-a7c183e42a26 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 200 len: 1311 microversion: 2.1 time: 0.155625 Aug 27 03:34:56.433034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 401/765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:56 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:56.849506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.850893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:56.857823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.858301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:56.859610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.860249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.086302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.095472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-83b1e4fe-3e84-4a36-bb07-1facf2f93393 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1711 microversion: 2.1 time: 0.250148 Aug 27 03:34:57.096059 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 365/766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:56 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1711 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:57.151982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.152457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.159194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.159632 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.160404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.160827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.188198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:34:57.189251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:57.190736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.197485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.197926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.198720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.199321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.280382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bb48e7f9-7f5e-4c70-a7bd-358b0e3df70b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 204 len: 0 microversion: 2.1 time: 0.131734 Aug 27 03:34:57.281794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 402/767] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:34:57 2021] DELETE /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:57.292288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.293148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.300640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.301213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.302072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.302526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.498004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c637ee2d-8cc6-45cc-b0c8-b0950d80e80e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28598 microversion: 2.20 time: 0.313054 Aug 27 03:34:57.499418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 366/768] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:57 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28598 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:57.508051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.510134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: ef870f4c-a749-484d-a466-9be119c21dbf] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.517643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.518125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.518900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.519328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.533238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] HTTP exception thrown: Instance ef870f4c-a749-484d-a466-9be119c21dbf could not be found. Aug 27 03:34:57.533827 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Returning 404 to user: Instance ef870f4c-a749-484d-a466-9be119c21dbf could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:34:57.534703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4dfa0c08-82c2-4866-9022-6c7e9df891ab tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf" status: 404 len: 111 microversion: 2.1 time: 0.034961 Aug 27 03:34:57.535540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 367/769] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:57 2021] GET /compute/v2.1/servers/ef870f4c-a749-484d-a466-9be119c21dbf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:57.541199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.543614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.544104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.549955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b1003382-1cc1-47b6-8bcd-73256981ae45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1515 microversion: 2.1 time: 0.262439 Aug 27 03:34:57.550769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.551403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.552351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.552974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.565770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 403/770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:57 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:57.582228 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:34:57.662493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7d09bd45-0c87-4b72-95af-1bf3b74e8016 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "DELETE /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 204 len: 0 microversion: 2.1 time: 0.122380 Aug 27 03:34:57.663512 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 368/771] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:34:57 2021] DELETE /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:34:57.673091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.673699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.679969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.680483 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.681412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.682007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.116116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.117487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:58.128718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.129165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.130090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.130604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.135040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.143920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-092219c0-0f32-4a03-935c-34d6295f8792 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.475606 Aug 27 03:34:58.144577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 404/772] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:57 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:58.383663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.392965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ade931ab-346d-4b7e-8bf4-ee817cf1d9dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1715 microversion: 2.1 time: 0.282457 Aug 27 03:34:58.393556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 369/773] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:58 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1715 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:58.516831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:58.517888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:58.518892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-d93874bd-1e10-4afb-addc-73ddaf25e68c req-ddcc49e5-aef6-4cd6-8748-812a6ad02946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259f7cfe-9ee5-44ec-b227-d524587c5600", "tag": "12277069-4498-4469-9aee-a13eb400f6d3"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:58.521865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:58.521865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:34:58.529556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-d93874bd-1e10-4afb-addc-73ddaf25e68c req-ddcc49e5-aef6-4cd6-8748-812a6ad02946 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.530361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-d93874bd-1e10-4afb-addc-73ddaf25e68c req-ddcc49e5-aef6-4cd6-8748-812a6ad02946 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.532622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.533444 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.534736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.535363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.544731 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-d93874bd-1e10-4afb-addc-73ddaf25e68c req-ddcc49e5-aef6-4cd6-8748-812a6ad02946 service nova] Creating event network-changed:12277069-4498-4469-9aee-a13eb400f6d3 for instance 259f7cfe-9ee5-44ec-b227-d524587c5600 on hv-cinder-77398 Aug 27 03:34:58.550110 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-d93874bd-1e10-4afb-addc-73ddaf25e68c req-ddcc49e5-aef6-4cd6-8748-812a6ad02946 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043187 Aug 27 03:34:58.551074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 405/774] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:58.568629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.569575 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:58.580382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.580911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.581777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.582310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.746455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.754871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fcb1c900-6ec0-4f5a-96dc-603f8d462b0e tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1515 microversion: 2.1 time: 0.190234 Aug 27 03:34:58.755616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 406/775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:58 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:58.769614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8c471aae-42a7-419b-92d1-75d7999d6a25 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28598 microversion: 2.20 time: 0.261960 Aug 27 03:34:58.770448 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 370/776] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:58 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28598 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:59.160905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:59.161683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:59.168678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.169341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.170369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.170963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.408871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:59.416857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6236bb14-e38f-4f76-a5ea-3c93c39bf155 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.259887 Aug 27 03:34:59.417454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 407/777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:59 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:59.773032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:59.773737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:59.780399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.781453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.782261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.782699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.782914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:59.783843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:59.789641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.790045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.790817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.791245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.916956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:59.924409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d659ceb6-afd7-40ac-bf96-a447e76c05c2 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1515 microversion: 2.1 time: 0.155447 Aug 27 03:34:59.924979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 371/778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:59 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:59.976502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2582f190-c023-451f-ab3e-9b0ad69dbf6a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28599 microversion: 2.20 time: 0.198221 Aug 27 03:34:59.977151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 408/779] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:59 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28599 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:00.435295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:00.436015 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:00.443407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.444010 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.444832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.445425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.570534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.577867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d7307ec3-8f75-4ab8-af0c-3256e453d460 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.146799 Aug 27 03:35:00.578760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 372/780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:00 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:00.942671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:00.943274 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:00.949634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.950097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.950853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.951275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.988306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:00.989270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:00.997222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.997657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.998488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.998915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.084592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.094447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0e3aeb3f-7745-4d49-b48e-f744cae51734 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1515 microversion: 2.1 time: 0.155247 Aug 27 03:35:01.095060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 409/781] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:00 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:01.273870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-75df7afa-3d7e-4b05-90fd-03b86a65ab31 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.289601 Aug 27 03:35:01.274575 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 373/782] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:00 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:01.594563 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.595176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:01.600980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.601421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.602226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.602656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.798567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.809731 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f427edf9-355e-4897-af37-8b5124686df6 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.218520 Aug 27 03:35:01.810703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 410/783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:01 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:02.114996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.115674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:02.123118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.123593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.124522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.125505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.195485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:02.204570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e50b8bab-c713-4cd5-b203-bdc8b398d39b tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1473 microversion: 2.1 time: 0.094569 Aug 27 03:35:02.215676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 374/784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:02 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1473 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:02.241479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-7664c196-ff3f-453a-a1eb-102d3792415e req-7a752b47-7187-4745-aa27-379d27a5f518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bcfa74-f228-4e6c-842b-66a5cad93c7a", "name": "network-vif-deleted", "tag": "e8511243-ef8e-4d2c-a8e0-aa94a2ff41d1"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:02.244216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:02.244216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:35:02.252944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-7664c196-ff3f-453a-a1eb-102d3792415e req-7a752b47-7187-4745-aa27-379d27a5f518 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.254821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-7664c196-ff3f-453a-a1eb-102d3792415e req-7a752b47-7187-4745-aa27-379d27a5f518 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.266240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-7664c196-ff3f-453a-a1eb-102d3792415e req-7a752b47-7187-4745-aa27-379d27a5f518 service nova] Creating event network-vif-deleted:e8511243-ef8e-4d2c-a8e0-aa94a2ff41d1 for instance f8bcfa74-f228-4e6c-842b-66a5cad93c7a on hv-cinder-77398 Aug 27 03:35:02.271343 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-7664c196-ff3f-453a-a1eb-102d3792415e req-7a752b47-7187-4745-aa27-379d27a5f518 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034651 Aug 27 03:35:02.272176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 411/785] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:02.285646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:02.286723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:02.293504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.294073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.294937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.295445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.524909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e1ad9d6c-9157-4577-a7a2-b9d8767b1acf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.243291 Aug 27 03:35:02.525562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 375/786] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:02 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:02.831212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.831910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:02.837982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.838469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.839238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.839667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.971901 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:02.979383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9a28e541-bfd9-47a3-af63-92804fee533f tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.152649 Aug 27 03:35:02.979959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 412/787] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:02 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:03.223855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.224589 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:03.231453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.231905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.232686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.233117 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.272185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.272641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.273100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'fault' on Instance uuid f8bcfa74-f228-4e6c-842b-66a5cad93c7a {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:35:03.323702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.332042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8dc38f12-21f7-4700-b529-ec753baff20f tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 200 len: 1308 microversion: 2.1 time: 0.112110 Aug 27 03:35:03.332887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 376/788] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:03 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:03.537495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:03.538519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:03.544625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.545072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.545843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.546316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.663906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-226b14ee-22b2-433d-a554-b46f0a1e46db tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.129861 Aug 27 03:35:03.664441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 413/789] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:03 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:03.996409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.997020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.003298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.003748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.004523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.004960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.133703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.144309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d4df3c1d-326c-4dc8-82bb-02f46539d4bf tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.151509 Aug 27 03:35:04.144916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 377/790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:03 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.350899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.351502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: f8bcfa74-f228-4e6c-842b-66a5cad93c7a] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.357906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.358376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.359647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.360241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.386935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] HTTP exception thrown: Instance f8bcfa74-f228-4e6c-842b-66a5cad93c7a could not be found. Aug 27 03:35:04.387530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Returning 404 to user: Instance f8bcfa74-f228-4e6c-842b-66a5cad93c7a could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:04.388376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9ab742e0-661e-4c0b-b064-30f8167ce46a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a" status: 404 len: 111 microversion: 2.1 time: 0.041677 Aug 27 03:35:04.388940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 414/791] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:04 2021] GET /compute/v2.1/servers/f8bcfa74-f228-4e6c-842b-66a5cad93c7a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:04.397276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.398811 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.405188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.405626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.406434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.406855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.432393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:35:04.511433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9287c1d4-6827-4878-b6e5-5a808d273f73 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 204 len: 0 microversion: 2.1 time: 0.117603 Aug 27 03:35:04.512275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 378/792] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:35:04 2021] DELETE /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:04.520710 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.521325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.527764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.528275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.529066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.529724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.674678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.676840 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:04.677865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.683738 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5ddf54a2-234a-4aeb-a381-0176d15db6e7 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1514 microversion: 2.1 time: 0.166723 Aug 27 03:35:04.684029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.684311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 415/793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:04 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.684661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.685485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.685918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.824725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-268e16c1-7edc-45d9-b682-8c5d2561bac0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.152871 Aug 27 03:35:04.825540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 379/794] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:04 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:05.163395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.164005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.170055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.170511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.171806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.172368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.304379 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.312560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a3b13b91-5a43-4578-8f44-a5bf36492ea1 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.153255 Aug 27 03:35:05.314154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 416/795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:05 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:05.703770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.704469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.711115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.711565 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.712357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.712783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.836995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:05.838175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.838586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.846333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.846789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.846934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4bc93459-8571-42d8-a3fd-3b5e25e719e1 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1514 microversion: 2.1 time: 0.147327 Aug 27 03:35:05.847689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 380/796] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:05 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:05.847807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.848030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.990606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3a92392a-75b1-4a34-a6e8-1d22c228f0eb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.157217 Aug 27 03:35:05.991270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 417/797] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:05 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:06.330091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.330843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:06.336820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.337267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.338095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.338531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.486253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.493518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-291d85a8-cf4a-4c94-95c9-0898bf2c0882 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.167168 Aug 27 03:35:06.494096 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 381/798] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:06 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:06.864939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.865640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:06.872647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.872979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.873667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.874136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.002093 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:07.003028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:07.009407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.009853 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.010691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.011124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.017461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.024739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6bac3134-5c3a-4e8a-999e-9868d5791945 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1514 microversion: 2.1 time: 0.163892 Aug 27 03:35:07.025867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 418/799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:06 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:07.261000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f438ba3d-44d2-4cab-967e-6e98dc49bf0b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.262659 Aug 27 03:35:07.264842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 382/800] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:06 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:07.511697 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.512327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:07.518963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.519506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.520278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.520706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.705762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.713488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-005bed81-bf3e-431c-9860-75fb81dea9de tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1522 microversion: 2.1 time: 0.205553 Aug 27 03:35:07.714118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 419/801] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:07 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:07.803854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-c5cf1227-1392-4ad8-8259-ea70dffc5b0a req-5dfeac75-1bd1-4660-83bd-5687cb302138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083b799e-ea07-441c-8703-8dc5f55c3c8b", "name": "network-vif-deleted", "tag": "e720968b-57f5-4bbf-9203-971f369a9bb6"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:07.805434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:07.805434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:35:07.814761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c5cf1227-1392-4ad8-8259-ea70dffc5b0a req-5dfeac75-1bd1-4660-83bd-5687cb302138 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.814761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c5cf1227-1392-4ad8-8259-ea70dffc5b0a req-5dfeac75-1bd1-4660-83bd-5687cb302138 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.827042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-c5cf1227-1392-4ad8-8259-ea70dffc5b0a req-5dfeac75-1bd1-4660-83bd-5687cb302138 service nova] Creating event network-vif-deleted:e720968b-57f5-4bbf-9203-971f369a9bb6 for instance 083b799e-ea07-441c-8703-8dc5f55c3c8b on hv-cinder-77398 Aug 27 03:35:07.833645 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-c5cf1227-1392-4ad8-8259-ea70dffc5b0a req-5dfeac75-1bd1-4660-83bd-5687cb302138 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Aug 27 03:35:07.834298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 383/802] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:08.041675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.042250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.049294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.049743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.050552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.050981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.085415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.085851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.086333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'fault' on Instance uuid 083b799e-ea07-441c-8703-8dc5f55c3c8b {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:35:08.144959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.152371 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-54931aa4-b8ba-4755-9786-335e5e973534 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 200 len: 1307 microversion: 2.1 time: 0.114352 Aug 27 03:35:08.152960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 420/803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:08 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:08.273426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:08.274466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.281313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.281937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.283265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.286325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.418924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e6aa6e08-59f1-41c4-821e-bb6785e652a4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.149406 Aug 27 03:35:08.419701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 384/804] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:08 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:08.731040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.731660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.738696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.739141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.739923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.740356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.772514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.773225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.773677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lazy-loading 'fault' on Instance uuid 248b6ca4-52d6-42f2-8ab8-823ee2872a2c {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:35:08.822926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fc63838314b0e96fa7939c4bced89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe951b6601f41469ba188c9b4ea1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.830893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-04b11021-4421-4fc9-b03f-77c57e0db403 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 200 len: 1311 microversion: 2.1 time: 0.103608 Aug 27 03:35:08.831465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 421/805] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:08 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:09.168804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.169505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 083b799e-ea07-441c-8703-8dc5f55c3c8b] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:09.176051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.176500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.177270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.177704 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.202103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] HTTP exception thrown: Instance 083b799e-ea07-441c-8703-8dc5f55c3c8b could not be found. Aug 27 03:35:09.204692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Returning 404 to user: Instance 083b799e-ea07-441c-8703-8dc5f55c3c8b could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:09.204692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-12f55290-91dc-47ed-bd16-65a7b00afb60 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b" status: 404 len: 111 microversion: 2.1 time: 0.039534 Aug 27 03:35:09.205305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 385/806] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:09 2021] GET /compute/v2.1/servers/083b799e-ea07-441c-8703-8dc5f55c3c8b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:09.431928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:09.432747 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:09.439584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.440031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.440795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.441230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.544652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9914524b-6cde-4cba-9b4d-d3039ae88158 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.116186 Aug 27 03:35:09.545571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 422/807] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:09 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:09.848745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.850214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] [instance: 248b6ca4-52d6-42f2-8ab8-823ee2872a2c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:09.850513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-2b9901e7-e753-49c5-a896-f8a8fa0b6358 req-1417fee7-7e5c-4804-8848-d450e632966a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248b6ca4-52d6-42f2-8ab8-823ee2872a2c", "name": "network-vif-deleted", "tag": "9a6e660c-1d4b-4a72-9ee8-af4d5608ba4d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:09.852063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:09.852063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:35:09.857267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.857918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.859303 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.860405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-2b9901e7-e753-49c5-a896-f8a8fa0b6358 req-1417fee7-7e5c-4804-8848-d450e632966a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.860608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.860830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-2b9901e7-e753-49c5-a896-f8a8fa0b6358 req-1417fee7-7e5c-4804-8848-d450e632966a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.871759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-2b9901e7-e753-49c5-a896-f8a8fa0b6358 req-1417fee7-7e5c-4804-8848-d450e632966a service nova] Creating event network-vif-deleted:9a6e660c-1d4b-4a72-9ee8-af4d5608ba4d for instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c on hv-cinder-77398 Aug 27 03:35:09.877638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-2b9901e7-e753-49c5-a896-f8a8fa0b6358 req-1417fee7-7e5c-4804-8848-d450e632966a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030984 Aug 27 03:35:09.878190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 423/808] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:09.878509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] HTTP exception thrown: Instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c could not be found. Aug 27 03:35:09.879484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] Returning 404 to user: Instance 248b6ca4-52d6-42f2-8ab8-823ee2872a2c could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:09.881289 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9bb88f62-0c88-4403-a133-4437ec3120d2 tempest-ServerRescueNegativeTestJSON-1942700960 tempest-ServerRescueNegativeTestJSON-1942700960-project] 10.222.0.48 "GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c" status: 404 len: 111 microversion: 2.1 time: 0.036416 Aug 27 03:35:09.883576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 386/809] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:09 2021] GET /compute/v2.1/servers/248b6ca4-52d6-42f2-8ab8-823ee2872a2c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:10.342071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:10.342698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:10.350709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.351166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.351944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.352378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.378092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:35:10.469154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c8e69fc8-eb2c-4e40-84fd-3d56875165aa tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 204 len: 0 microversion: 2.1 time: 0.127171 Aug 27 03:35:10.472503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 424/810] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:35:10 2021] DELETE /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:10.478430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:10.479415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:10.486298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.486892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.487777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.488330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.558372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:10.559719 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:10.566736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.567180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.567950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.568378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.710350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f923d4b1-8f7c-4744-9046-49943c1e0322 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.156191 Aug 27 03:35:10.711318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 425/811] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:10 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:10.807661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:10.816427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-accd8e7b-86da-454a-8025-be1c429e21ae tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1514 microversion: 2.1 time: 0.344002 Aug 27 03:35:10.817000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 387/812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:10 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:11.724254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:11.725271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:11.731803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.732248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.733079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.733458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.834895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:11.835602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:11.845591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.846075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.846865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.847293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.870520 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ecb5c6cc-87ca-4e9b-8682-15813835521f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.150150 Aug 27 03:35:11.871568 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 426/813] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:11 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:12.205626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:12.214259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7de17a18-8122-47f9-9e5f-598e63566b53 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1514 microversion: 2.1 time: 0.383075 Aug 27 03:35:12.215192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 388/814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:11 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1514 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:12.885600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:12.886567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:12.893847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.894315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.895120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.895544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.040392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-372a3e6e-2968-43e6-a893-59827fa45493 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.157302 Aug 27 03:35:13.046845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 427/815] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:12 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:13.236579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:13.237211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:13.244302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.244746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.245526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.246899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.590334 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.599451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2fc137b2-c88b-4792-924f-54be827d7a45 tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1514 microversion: 2.1 time: 0.368209 Aug 27 03:35:13.603938 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 389/816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:13 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:14.064156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:14.065820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:14.079014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.079542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.080479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.081197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.202807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fba88965-c806-4307-b2c4-d2c1551e2d78 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.146406 Aug 27 03:35:14.204475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 428/817] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:14 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:14.242580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-44de9878-81ab-42fc-909a-cdba68d7d989 req-f242bb45-0bd6-42a2-a5c4-7f49ae864419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8d878f-cb25-4cd8-b690-81e8698f2a1f", "name": "network-vif-deleted", "tag": "34897c05-7eef-4339-91c9-e3bfd1114a68"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:14.244154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:14.244154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:35:14.252594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-44de9878-81ab-42fc-909a-cdba68d7d989 req-f242bb45-0bd6-42a2-a5c4-7f49ae864419 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.253313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-44de9878-81ab-42fc-909a-cdba68d7d989 req-f242bb45-0bd6-42a2-a5c4-7f49ae864419 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.271531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-44de9878-81ab-42fc-909a-cdba68d7d989 req-f242bb45-0bd6-42a2-a5c4-7f49ae864419 service nova] Creating event network-vif-deleted:34897c05-7eef-4339-91c9-e3bfd1114a68 for instance 2b8d878f-cb25-4cd8-b690-81e8698f2a1f on hv-cinder-77398 Aug 27 03:35:14.281313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-44de9878-81ab-42fc-909a-cdba68d7d989 req-f242bb45-0bd6-42a2-a5c4-7f49ae864419 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042140 Aug 27 03:35:14.282706 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 390/818] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:14.620940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:14.621787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:14.629344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.629806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.630658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.631071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.667403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.667841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.668301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lazy-loading 'fault' on Instance uuid 2b8d878f-cb25-4cd8-b690-81e8698f2a1f {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:35:14.727896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509234c4194142a4b0634c6f08776161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e01c1992d424c8ea95add2a0ee8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:14.736860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9fa08962-4305-4625-b3b7-ccc9b8cc722a tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 200 len: 1308 microversion: 2.1 time: 0.119862 Aug 27 03:35:14.737471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 429/819] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:14 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.220459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:15.220459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:15.226559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.227003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.228090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.228680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.341142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7e235605-38e5-44cd-8718-f6267e809fc8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.127586 Aug 27 03:35:15.347135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 391/820] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:15 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:15.758275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:15.759192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] [instance: 2b8d878f-cb25-4cd8-b690-81e8698f2a1f] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:15.767018 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.767494 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.768302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.768933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.797367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] HTTP exception thrown: Instance 2b8d878f-cb25-4cd8-b690-81e8698f2a1f could not be found. Aug 27 03:35:15.797966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] Returning 404 to user: Instance 2b8d878f-cb25-4cd8-b690-81e8698f2a1f could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:15.798845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-447d58ef-c9bd-47d8-8b4b-1b11afe4fada tempest-AttachVolumeNegativeTest-421436559 tempest-AttachVolumeNegativeTest-421436559-project] 10.222.0.48 "GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f" status: 404 len: 111 microversion: 2.1 time: 0.045290 Aug 27 03:35:15.799385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 430/821] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:15 2021] GET /compute/v2.1/servers/2b8d878f-cb25-4cd8-b690-81e8698f2a1f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:16.354873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:16.355904 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:16.364079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.364079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.364947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.365629 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.476453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0b5df923-3657-413b-9c56-4b053c085460 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.125507 Aug 27 03:35:16.481728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 392/822] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:16 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:16.943875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a6767e38-5717-4541-9cb5-753c99c8a127 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1308eddc0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.022331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a6767e38-5717-4541-9cb5-753c99c8a127 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/571349b2-b202-43ff-ab2d-7a09e8ad92b0" status: 200 len: 350 microversion: 2.1 time: 0.084773 Aug 27 03:35:17.029145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 431/823] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:35:16 2021] GET /compute/v2.1/os-volumes/571349b2-b202-43ff-ab2d-7a09e8ad92b0 => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:17.490148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:17.491443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:17.498094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.498533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.499840 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.500574 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.633231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b7178fa2-7d55-4ffa-a387-9ab76a28085c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.147367 Aug 27 03:35:17.633887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 393/824] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:17 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:17.784460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-33d39270-1e30-4069-b1b5-2b33e63cf2cd tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Action: 'create', calling method: .version_select at 0x7fb1307101f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2065156742", "metadata": {"Type": "work"}}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:17.785899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-33d39270-1e30-4069-b1b5-2b33e63cf2cd tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:17.786802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-33d39270-1e30-4069-b1b5-2b33e63cf2cd tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149478 Aug 27 03:35:17.787361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 432/825] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Aug 27 03:35:17 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:35:17.797294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ddcf796b-2396-4504-b20b-5663c526783e tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Action: 'create', calling method: .version_select at 0x7fb1307d90d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1940684294", "metadata": {"Type": "work"}}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:17.798733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ddcf796b-2396-4504-b20b-5663c526783e tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:17.799523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ddcf796b-2396-4504-b20b-5663c526783e tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006864 Aug 27 03:35:17.800032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 394/826] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Aug 27 03:35:17 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:35:17.810459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2a746fcb-eb97-41f7-8a58-7a5ab42f404f tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Action: 'create', calling method: .version_select at 0x7fb1311a40d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-808551151", "metadata": {"Type": "work"}}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:17.811588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2a746fcb-eb97-41f7-8a58-7a5ab42f404f tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:17.813590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2a746fcb-eb97-41f7-8a58-7a5ab42f404f tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008608 Aug 27 03:35:17.814138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 433/827] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Aug 27 03:35:17 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:35:17.825154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e75ba1fa-e9f1-4797-afda-a444d9e92833 tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Calling method '.version_select at 0x7fb130623f70>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.852598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-e75ba1fa-e9f1-4797-afda-a444d9e92833 tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] HTTP exception thrown: Volume tempest-invalid-1510151948 could not be found. Aug 27 03:35:17.853197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e75ba1fa-e9f1-4797-afda-a444d9e92833 tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Returning 404 to user: Volume tempest-invalid-1510151948 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:17.854059 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e75ba1fa-e9f1-4797-afda-a444d9e92833 tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1510151948" status: 404 len: 99 microversion: 2.1 time: 0.032965 Aug 27 03:35:17.854598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 395/828] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Aug 27 03:35:17 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1510151948 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:35:17.864053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4c14f128-bd3e-4d42-997c-93df99de15a1 tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003662 Aug 27 03:35:17.864546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 434/829] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Aug 27 03:35:17 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:35:17.872746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-92c929cd-e4f0-4896-b411-b67a72d2d318 tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003423 Aug 27 03:35:17.873227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 396/830] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Aug 27 03:35:17 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:35:17.881457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-011b075d-725d-4ec9-80f8-80ece28121da tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Calling method '.version_select at 0x7fb1308a40d0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.908856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-011b075d-725d-4ec9-80f8-80ece28121da tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] HTTP exception thrown: Volume d8011231-9249-430a-b35b-e73bc8bee162 could not be found. Aug 27 03:35:17.909526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-011b075d-725d-4ec9-80f8-80ece28121da tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Returning 404 to user: Volume d8011231-9249-430a-b35b-e73bc8bee162 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:17.910392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-011b075d-725d-4ec9-80f8-80ece28121da tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d8011231-9249-430a-b35b-e73bc8bee162" status: 404 len: 109 microversion: 2.1 time: 0.032221 Aug 27 03:35:17.910921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 435/831] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Aug 27 03:35:17 2021] DELETE /compute/v2.1/os-volumes/d8011231-9249-430a-b35b-e73bc8bee162 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:17.919480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dcfdb9bd-0c39-41f3-84f1-0c8f71b5377d tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Calling method '.version_select at 0x7fb13073ad30>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.945985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-dcfdb9bd-0c39-41f3-84f1-0c8f71b5377d tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] HTTP exception thrown: Volume f2bd63d4-b500-43cb-82b3-aeff00e8b974 could not be found. Aug 27 03:35:17.946616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dcfdb9bd-0c39-41f3-84f1-0c8f71b5377d tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] Returning 404 to user: Volume f2bd63d4-b500-43cb-82b3-aeff00e8b974 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:17.947476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dcfdb9bd-0c39-41f3-84f1-0c8f71b5377d tempest-VolumesNegativeTest-136742655 tempest-VolumesNegativeTest-136742655-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f2bd63d4-b500-43cb-82b3-aeff00e8b974" status: 404 len: 109 microversion: 2.1 time: 0.031542 Aug 27 03:35:17.948002 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 397/832] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:35:17 2021] GET /compute/v2.1/os-volumes/f2bd63d4-b500-43cb-82b3-aeff00e8b974 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:18.465845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ef6756eb-ca09-48b1-8297-e6ad193abf3d tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb130757430>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:18.547609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ef6756eb-ca09-48b1-8297-e6ad193abf3d tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e2728b73-32bc-4bcb-820d-5815c3133bb8" status: 200 len: 350 microversion: 2.1 time: 0.085695 Aug 27 03:35:18.548272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 436/833] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:35:18 2021] GET /compute/v2.1/os-volumes/e2728b73-32bc-4bcb-820d-5815c3133bb8 => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:18.645897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:18.648107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:18.658238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:18.659581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:18.660954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:18.662046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:18.788897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-185ec648-0cbf-4dac-869d-3e42c6bbe24b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.146661 Aug 27 03:35:18.789542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 398/834] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:18 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:19.801968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:19.802910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:19.808762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.809221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.809983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.810440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.916753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6280f975-9c2c-4089-a75a-7dd11adc1dad tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.118288 Aug 27 03:35:19.918054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 437/835] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:19 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:20.930519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:20.931521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:20.938999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:20.939449 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:20.940236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:20.940670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.028214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-895ab975-2bfc-4510-a1f8-bfa6d3fd4007 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1307b1310>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.043895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8cc32acf-80cc-4743-89ca-ec70e3cdf5a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.117060 Aug 27 03:35:21.044593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 399/836] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:20 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:21.085569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-895ab975-2bfc-4510-a1f8-bfa6d3fd4007 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/10d2d5e0-279e-449d-899e-1f0f5f6085e3" status: 200 len: 349 microversion: 2.1 time: 0.061276 Aug 27 03:35:21.086180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 438/837] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes/10d2d5e0-279e-449d-899e-1f0f5f6085e3 => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:21.099122 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6bebad77-ec60-431c-9989-08cd97fb9acf tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1305c7040>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.181703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6bebad77-ec60-431c-9989-08cd97fb9acf tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.087980 Aug 27 03:35:21.182410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 400/838] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:21.194739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4c5877ed-a418-433e-a7c2-54fb00112070 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1307bddc0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.278679 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4c5877ed-a418-433e-a7c2-54fb00112070 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.087555 Aug 27 03:35:21.279250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 439/839] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:21.291801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d0c65828-378c-46f0-9c78-40ae316fbfdb tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb13073aa60>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.373630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d0c65828-378c-46f0-9c78-40ae316fbfdb tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.085293 Aug 27 03:35:21.374877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 401/840] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:21.386919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ad05cf3c-4e66-4842-97c5-9bfba4e81b46 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1307cf550>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.467571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ad05cf3c-4e66-4842-97c5-9bfba4e81b46 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084617 Aug 27 03:35:21.468879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 440/841] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:21.482491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3992d7ee-df39-443c-90cc-a2f58310cf55 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb130623160>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.576290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3992d7ee-df39-443c-90cc-a2f58310cf55 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.097251 Aug 27 03:35:21.576947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 402/842] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:21.588679 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-12843590-5f95-4eee-9907-f83c52f521f0 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1307cf700>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.678525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-12843590-5f95-4eee-9907-f83c52f521f0 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.093513 Aug 27 03:35:21.679087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 441/843] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:21.690131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-00d7048d-598c-4def-84cb-8ab7c5424d52 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1305c7b80>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.771047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-00d7048d-598c-4def-84cb-8ab7c5424d52 tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084719 Aug 27 03:35:21.771767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 403/844] 10.222.0.48 () {58 vars in 1188 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:21.784502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5a8b5ee4-5ad3-45e8-893a-e509a3a11bbe tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] Calling method '.version_select at 0x7fb1307b1820>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.883757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5a8b5ee4-5ad3-45e8-893a-e509a3a11bbe tempest-VolumesTestJSON-1584036906 tempest-VolumesTestJSON-1584036906-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.103572 Aug 27 03:35:21.884405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 442/845] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:22.056602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:22.057657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:22.065669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.066175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.066952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.067377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.198442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f2769907-2c0c-48d0-8422-29ef52a4940c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.145280 Aug 27 03:35:22.199223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 404/846] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:22 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:23.212518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:23.213470 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:23.220424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.220867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:23.221645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.222113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:23.325085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b9dee182-ec22-4db0-9a3c-c999a22f2fe9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.116646 Aug 27 03:35:23.325802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 443/847] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:23 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:24.338254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:24.339286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:24.346790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:24.347238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.348047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:24.348477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.453894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-90df2242-25a2-4c3c-a40b-fa1aca0b4c5f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.119144 Aug 27 03:35:24.454635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 405/848] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:24 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:25.466518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:25.469688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:25.478456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.479512 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.480659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.481396 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.601640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4dc81aa4-356e-4767-a861-2c6856697e60 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.139443 Aug 27 03:35:25.602545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 444/849] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:25 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:26.613477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:26.614519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:26.621244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.621689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.622510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.623174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.727571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-70c90425-6652-41c6-aa0d-fe452b5add15 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.118165 Aug 27 03:35:26.728224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 406/850] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:26 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:27.741156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:27.742232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:27.749611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.750925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.751772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.752306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.853939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-39046d6c-4fc3-4b53-b2d7-d8a560dc22df tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.111434 Aug 27 03:35:27.853939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 445/851] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:27 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:28.862665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:28.863793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:28.871354 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:28.871909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.872790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:28.873224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.979927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-33776ebe-506d-4709-8f37-01cd858715f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.121990 Aug 27 03:35:28.980606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 407/852] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:28 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:29.992279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:29.993273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:29.999660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.000126 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.000896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.001323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.098191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f7c0d692-4f8d-4627-924c-292505e62d81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.109842 Aug 27 03:35:30.098982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 446/853] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:29 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:31.110925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:31.111931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:31.119158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.119637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:31.120474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.120990 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:31.212982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9c748f93-c448-48be-80ec-6e3abbc9736b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.106597 Aug 27 03:35:31.217254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 408/854] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:31 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:32.225988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:32.227205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:32.233510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.233950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.235273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.235893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.334452 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-500075d1-f457-4cf6-b439-0ac16abcbcb1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.112313 Aug 27 03:35:32.338213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 447/855] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:32 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:33.346761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:33.348044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:33.354595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.355043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.355997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.356433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.455417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e0b3de85-599b-4992-ba73-205e693713d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.112529 Aug 27 03:35:33.462567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 409/856] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:33 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:34.473663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:34.474700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:34.481050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.481498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.482292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.482729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.575908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-aa0f3972-9a75-474d-9d59-cf5c19b9be12 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.106575 Aug 27 03:35:34.576573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 448/857] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:34 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:35.591148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:35.591148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:35.596645 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.597094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.597868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.598331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.686714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-953dba5e-47c5-48d5-9885-4788fb377802 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.101535 Aug 27 03:35:35.691598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 410/858] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:35 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:35:36.700093 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:36.701255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:36.709195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.709670 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.710499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.710965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.807541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9f302ae6-5f11-4729-8c77-db3b099668e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.111404 Aug 27 03:35:36.808412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 449/859] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:36 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:37.820102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:37.821220 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:37.827962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:37.828486 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:37.829512 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:37.830041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:37.921500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5d6947a7-f8f9-48c2-a62c-c7fe8cc4e8ff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.100165 Aug 27 03:35:37.921500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 411/860] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:37 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:38.929560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:38.930586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:38.937254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:38.937956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:38.939384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:38.940015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:39.030778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-19bdd598-f67e-4616-9794-3dce46804282 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.105203 Aug 27 03:35:39.031424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 450/861] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:38 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:40.044291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:40.045901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:40.053368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:40.053905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:40.054790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:40.055314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:40.151116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5ff9b892-481b-40fe-9ad1-008f80c665cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.111840 Aug 27 03:35:40.151770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 412/862] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:40 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:41.164216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:41.165827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:41.172489 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:41.174235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:41.175091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:41.175529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:41.260931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-aaab5ba1-d85e-48f6-9937-1b247479e259 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.100697 Aug 27 03:35:41.261590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 451/863] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:41 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:42.273664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:42.274707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:42.281190 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:42.281647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:42.282574 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:42.283012 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:42.367458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ce815d0b-da3a-4498-b5bd-4cbe63a921d1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 0.097601 Aug 27 03:35:42.368019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 413/864] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:42 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:43.380322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:43.381360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:43.388159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:43.388596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:43.389372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:43.389801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:46.355818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-301d1ad2-27ce-4cf3-9bd9-4b25876b3d54 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 28763 microversion: 2.20 time: 2.979711 Aug 27 03:35:46.356506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 452/865] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:43 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 28763 bytes in 2982 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:47.369137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:47.370165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:47.377913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:47.378440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:47.379255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:47.379771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:47.485617 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-191c0361-b5fa-428b-a806-a8ce28592149 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 30069 microversion: 2.20 time: 0.120286 Aug 27 03:35:47.486315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 414/866] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:47 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 30069 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:48.497451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:48.498409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:48.505662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:48.506431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:48.507213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:48.507834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:48.611114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-baef32ec-72ee-46b9-be2c-af2058760255 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 32050 microversion: 2.20 time: 0.116942 Aug 27 03:35:48.612520 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 453/867] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:48 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 32050 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:49.623027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:49.624009 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:49.631703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:49.632218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:49.633207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:49.633742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:52.749159 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-57f02f1e-eaba-4b05-be1b-9da3f6ece3a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 36466 microversion: 2.20 time: 3.129936 Aug 27 03:35:52.749865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 415/868] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:49 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 36466 bytes in 3132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:53.762678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:53.763689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:53.771054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:53.771502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:53.772794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:53.772794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:53.902147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c3a635a9-f8f8-4e73-a5eb-8e464785776f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 37812 microversion: 2.20 time: 0.143371 Aug 27 03:35:53.902914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 454/869] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:53 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 37812 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:54.915480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:54.916483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:54.923991 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:54.924484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:54.925213 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:54.925831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:58.628475 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5441dd18-26a4-4a7b-9e39-a13e3d32f35c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 38308 microversion: 2.20 time: 3.717370 Aug 27 03:35:58.629188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 416/870] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:54 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 38308 bytes in 3719 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:59.642324 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:59.643320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:59.650183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:59.650638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:59.651416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:59.651851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:59.756561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-af596ed7-d1c2-4f51-a493-76a1b89a55ba tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 38308 microversion: 2.20 time: 0.118958 Aug 27 03:35:59.757476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 455/871] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:59 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 38308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:00.768683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:00.769700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:00.776240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:00.776679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:00.777436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:00.777862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:00.867514 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1ff33241-f711-4280-915c-352ce389d999 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 38308 microversion: 2.20 time: 0.102622 Aug 27 03:36:00.868079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 417/872] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:36:00 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 38308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:01.879628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:01.880634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:01.887217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:01.887664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:01.888438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:01.888873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:01.983723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-88c3ee00-c82f-4f69-967f-af9c0c0005f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 200 len: 38450 microversion: 2.20 time: 0.108203 Aug 27 03:36:01.984384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 456/873] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:36:01 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 38450 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:01.994835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:01.995410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:02.001835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.002305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.003066 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.003495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.026917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eb51ffd6-ad52-4c17-adb5-14afd84278b4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/ips" status: 200 len: 152 microversion: 2.20 time: 0.036062 Aug 27 03:36:02.027487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 418/874] 10.222.0.48 () {60 vars in 1289 bytes} [Fri Aug 27 03:36:01 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:36:06.788600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:36:06.789143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:36:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:36:08.208264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:08.212995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:08.215773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.216220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.216996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.217430 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.290102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c02edcb2-4ed5-4f5f-aea5-05da4268468c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/action" status: 202 len: 0 microversion: 2.1 time: 0.087137 Aug 27 03:36:08.290776 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 457/875] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:08 2021] POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:36:08.299581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.300196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:08.307050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.307501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.308280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.308755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.707947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.716057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-066a3f53-8568-4841-add9-93ffb8df9686 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1747 microversion: 2.1 time: 0.420811 Aug 27 03:36:08.716632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 419/876] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:08 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1747 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:08.760786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:08.761324 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:08.767530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.767978 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.768833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.769168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.792839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lazy-loading 'flavor' on Instance uuid bef4e7c3-65e5-4239-b56a-84761b4b7cc5 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:36:09.176913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-71b1e71b-fcdd-4f92-bf63-6d09f46710f7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 202 len: 0 microversion: 2.20 time: 0.420194 Aug 27 03:36:09.177535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 458/877] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:36:08 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:09.185676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.186316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:09.193180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.193622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.194430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.194859 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.330982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.338743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.340245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.341369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b0f032a3-66f9-4c9f-9d17-24abe19b9a44 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.159420 Aug 27 03:36:09.341926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 420/878] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:09 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:09.735065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.735994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:09.742484 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.742935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.743711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.744141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.873947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.882775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f64678e2-f002-406e-806e-5f8edbe3f463 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1747 microversion: 2.1 time: 0.152858 Aug 27 03:36:09.883345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 459/879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:09 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:10.360794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.361402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:10.367901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.368342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.369115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.369548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.503529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.512845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.514380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.515532 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-14c5236a-498e-413e-b519-6f5ea580f438 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.158619 Aug 27 03:36:10.517045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 421/880] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:10 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:10.900813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.901365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:10.908512 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.908958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.909724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.910189 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.036063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.043984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ca5f9c56-f311-4f1d-8e15-7a779f622971 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1747 microversion: 2.1 time: 0.146904 Aug 27 03:36:11.044550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 460/881] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:10 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1747 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:11.535291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.535905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:11.541699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.542187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.542952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.543382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.666478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.674896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.676446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.677674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8dfb48ae-f82f-45df-9668-a66fe42880f1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.146961 Aug 27 03:36:11.678312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 422/882] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:11 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:12.062965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.064033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:12.069780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.070259 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.071053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.071629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.192191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.199840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-185f60f5-a55a-4915-b74c-ceecbddd8986 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1747 microversion: 2.1 time: 0.141729 Aug 27 03:36:12.200406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 461/883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:12 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1747 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:12.280038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:36:12.280279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:36:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:36:12.697029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.697654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:12.704280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.704736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.705511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.705941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.827293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.835863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.837369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.838720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3d2d1ec2-be44-45e6-9810-bf034384b9e5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.145550 Aug 27 03:36:12.839304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 423/884] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:12 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:13.217841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.218478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:13.225097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.225538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.226338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.226779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.356820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:13.364692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-89c041f2-d01c-411b-a850-b15cf4ca8438 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.150711 Aug 27 03:36:13.365275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 462/885] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:13 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:13.858388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.859030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:13.865397 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.865841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.866646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.867081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.996237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.004001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.005493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.006662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3cedf197-7249-43d0-afb9-4932d6fe340a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.152090 Aug 27 03:36:14.007223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 424/886] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:13 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:14.381471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:14.382066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:14.388192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:14.388636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:14.389413 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:14.389843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:14.521768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.529705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2e3c8b86-1237-40f7-a92b-16bdf721fc98 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.151933 Aug 27 03:36:14.530331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 463/887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:14 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:15.025657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.026306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:15.033078 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:15.033535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.034346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:15.034788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.156366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.164413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.165901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.167068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-064844f8-d038-4802-9afd-098ed3c627ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.145697 Aug 27 03:36:15.167632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 425/888] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:15 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:15.547941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.548443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:15.554302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:15.554745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.555503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:15.555927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.685096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.693902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a3b97c44-905e-4ded-87bb-43ac97326bff tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.150420 Aug 27 03:36:15.694693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 464/889] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:15 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:16.185430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.186044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:16.192958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.193396 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.194256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.194683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.323911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.331893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.333379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.334545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2507e3ee-8012-40a0-9304-fe4660c2ebc7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.152825 Aug 27 03:36:16.335101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 426/890] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:16 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:16.712438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.713052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:16.719906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.720365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.721137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.721572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.849461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.857247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-36af3203-baae-4b1e-8749-343aec88905e tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.148560 Aug 27 03:36:16.857812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 465/891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:16 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:17.352618 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:17.353258 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:17.359986 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.360608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.361600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.362058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.488015 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.496310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.497815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.499029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d3756241-4dcf-46fa-a73a-5c74a83fea46 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.150142 Aug 27 03:36:17.499626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 427/892] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:17 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:17.874811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:17.876066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:17.882266 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.882705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.883472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.883902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.023372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.031517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2758f02a-7d7f-4502-8f22-24c4e98eb6ad tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.160503 Aug 27 03:36:18.032131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 466/893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:17 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:18.518446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:18.519091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:18.526793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:18.527227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.528003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:18.528602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.659095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.669284 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.671080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.672721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e12c05fe-4499-482d-902c-f14fabb8f028 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.158525 Aug 27 03:36:18.673734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 428/894] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:18 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:19.049099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:19.049833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:19.055782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.056239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.057021 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.057462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.225079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:19.232995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ede93d5d-ad50-4e2a-9036-0c49f467d165 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.188504 Aug 27 03:36:19.233563 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 467/895] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:19 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:19.692261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:19.692881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:19.698677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.699151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.699903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.700330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.824431 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:19.833026 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:19.834537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:19.835680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-774b0c2a-16f7-4ec0-8357-dfa7b7dec091 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.147193 Aug 27 03:36:19.836234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 429/896] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:19 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:20.259609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:20.260247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:20.267152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:20.267633 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:20.268401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:20.268832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:20.389440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:20.397555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2e169cec-2ecb-43ed-8558-153671d0cf5b tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.141743 Aug 27 03:36:20.398158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 468/897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:20 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:20.855011 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:20.855579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:20.862040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:20.862493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:20.863254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:20.863683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:20.992819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.000609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.002370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.003517 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ce2da716-b5af-4abb-b986-130f518174b9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.152285 Aug 27 03:36:21.004083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 430/898] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:20 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:21.414178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:21.414795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:21.420837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:21.421284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:21.422585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:21.423043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:21.548949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.556830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d443d7fb-6931-416d-90f2-36f6316daf75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.146405 Aug 27 03:36:21.557406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 469/899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:21 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:22.021177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:22.021788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:22.027541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:22.027983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:22.028748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:22.029175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:22.160939 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.168666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.170196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.171337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a2271210-42e1-414f-84d4-2ef1fa2094bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.153973 Aug 27 03:36:22.172423 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 431/900] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:22 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:22.573627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:22.574260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:22.580912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:22.581350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:22.582142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:22.582570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:22.706190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.713884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-22b8e6b6-8cb3-41f0-815f-ab7500a048e2 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.143919 Aug 27 03:36:22.714473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 470/901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:22 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:23.189627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:23.190273 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:23.196520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:23.196962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:23.197731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:23.198189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:23.327384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.336685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.338280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.339599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1b0c1c2c-beaa-4376-8779-7f2fbe77f115 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.154161 Aug 27 03:36:23.340159 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 432/902] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:23 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:23.731471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:23.732088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:23.738596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:23.739156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:23.739925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:23.740354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:23.869222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.877864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d3fd06c1-346e-4cac-9098-99830d7bce78 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.150056 Aug 27 03:36:23.878473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 471/903] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:23 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:24.361192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.361792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:24.367604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:24.368048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:24.368806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:24.369235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:24.489924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:24.497576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:24.499099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:24.500898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-24239c71-46b2-4597-9b49-cbe2163cad36 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.143421 Aug 27 03:36:24.501611 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 433/904] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:24 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:24.897624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.898329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:24.904674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:24.905130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:24.905896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:24.906987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:25.032285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.040467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ae6cbbbb-c9da-418b-8c42-9529edf71fde tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.147413 Aug 27 03:36:25.041077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 472/905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:24 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:25.517837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:25.518469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:25.524236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:25.524692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:25.525454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:25.525891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:25.646853 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.655158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.657490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.658856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-24d9f8d5-7f0a-4dc7-9353-15a330571443 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.144726 Aug 27 03:36:25.659424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 434/906] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:25 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:26.058659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:26.059222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:26.066360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:26.066820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:26.067605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:26.068043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:26.197339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:26.207135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0afe1b1f-bdd3-443b-9e73-727f957ac49d tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.152102 Aug 27 03:36:26.207826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 473/907] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:26 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:26.677842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:26.678485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:26.684254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:26.684704 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:26.685480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:26.685914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:26.819157 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:26.827763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:26.829840 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:26.831028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3796f42e-3971-42e0-ab03-3b850427dae2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.156976 Aug 27 03:36:26.831783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 435/908] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:26 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:27.225060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:27.225795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:27.232066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:27.232503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:27.233265 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:27.233684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:27.361817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.369635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-57ec5581-fe2b-4d2a-bf45-3945d47f8303 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.148641 Aug 27 03:36:27.370379 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 474/909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:27 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:27.849725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:27.850372 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:27.856268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:27.856715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:27.857483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:27.857909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:27.982170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.990118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.991614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.992776 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-674fc517-b517-4377-ab26-4a972eff44d3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.146730 Aug 27 03:36:27.993307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 436/910] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:27 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:28.252871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:36:28.253680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:36:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:36:28.387393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:28.388000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:28.394129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:28.394603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:28.395416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:28.395769 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:28.527443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:28.536054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f390ac43-5166-4fb4-bdb2-fc9646808f30 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.152252 Aug 27 03:36:28.536668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 475/911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:28 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:29.010587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:29.011195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:29.017708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:29.018178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:29.018965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:29.019389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:29.136709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:29.145777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:29.147351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:29.148493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fad3906a-b099-422a-8374-e2d29aa4aa0a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.141636 Aug 27 03:36:29.149042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 437/912] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:29 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:29.553003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:29.553819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:29.559694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:29.560572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:29.560982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:29.561405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:29.695083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:29.702886 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bf60db9e-bd68-4fc9-b3be-900bfb8ad9d3 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.153577 Aug 27 03:36:29.704070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 476/913] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:29 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:30.166901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:30.167435 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:30.173837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:30.174313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:30.175087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:30.175524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:30.301225 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:30.308890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:30.310409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:30.311578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-125ee14e-bb98-4e4b-bd45-e0254e297abd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1744 microversion: 2.20 time: 0.148451 Aug 27 03:36:30.312158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 438/914] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:30 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:30.720655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:30.721314 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:30.727375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:30.727819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:30.728630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:30.729062 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:30.859191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:30.866969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-17315cce-5cb5-4a46-ad4a-9e62d70b9682 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1752 microversion: 2.1 time: 0.150489 Aug 27 03:36:30.867535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 477/915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:30 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:31.331016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:31.331841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:31.339049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:31.339499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:31.340279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:31.340711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:31.509922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:31.522824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:31.524626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:31.525959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-85817808-8ebb-4fba-afe8-972f9cb91c11 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1744 microversion: 2.20 time: 0.199463 Aug 27 03:36:31.526543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 439/916] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:31 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:31.884624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:31.885242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:31.891648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:31.892105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:31.892900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:31.893335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:32.317834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:32.326240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ad78948e-94ea-4ac5-9b6a-b9a5c0c3c182 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1755 microversion: 2.1 time: 0.445267 Aug 27 03:36:32.326815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 478/917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:31 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1755 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:32.553373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:32.553989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:32.560472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:32.560916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:32.561687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:32.562153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:32.688501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:32.696144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:32.697630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:32.698789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-332b3567-36a6-4495-981d-c73338ea14ac tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1744 microversion: 2.20 time: 0.149281 Aug 27 03:36:32.699378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 440/918] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:32 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:33.126848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-8cc37361-7625-4bdd-b987-463f423fd9ef req-13cd50a6-20c9-4159-bc18-33bb5169a8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:33.129105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:33.129105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:36:33.137423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-8cc37361-7625-4bdd-b987-463f423fd9ef req-13cd50a6-20c9-4159-bc18-33bb5169a8df service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:33.137860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-8cc37361-7625-4bdd-b987-463f423fd9ef req-13cd50a6-20c9-4159-bc18-33bb5169a8df service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:33.149485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-8cc37361-7625-4bdd-b987-463f423fd9ef req-13cd50a6-20c9-4159-bc18-33bb5169a8df service nova] Creating event network-vif-plugged:4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8 for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 on hv-cinder-77398 Aug 27 03:36:33.155805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-8cc37361-7625-4bdd-b987-463f423fd9ef req-13cd50a6-20c9-4159-bc18-33bb5169a8df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Aug 27 03:36:33.156849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 479/919] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:33.716705 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:33.717382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:33.725310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:33.725762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:33.726574 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:33.727009 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:33.855438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:33.863458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:33.865042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:33.866289 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9b125833-e063-4a1c-a591-bc0a9b8282ae tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1744 microversion: 2.20 time: 0.153220 Aug 27 03:36:33.866931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 441/920] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:33 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:34.884904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:34.885614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:34.891756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:34.892190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:34.892942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:34.893365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:35.016295 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:35.024222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:35.025626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:35.026791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fe263eca-bbf9-4776-ba3c-58f82efaac73 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1744 microversion: 2.20 time: 0.146030 Aug 27 03:36:35.027345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 480/921] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:34 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1744 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:36.044411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.044996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:36.051174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:36.051613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:36.052545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:36.053017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:36.191227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:36.199405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:36.200968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:36.202232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0358d1cb-4cc7-4bd4-a3f8-a58a5f657882 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1744 microversion: 2.20 time: 0.161820 Aug 27 03:36:36.203265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 442/922] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:36 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:37.221708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:37.222347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:37.228394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:37.228869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:37.229674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:37.230133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:37.356402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:37.367028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:37.369313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:37.370703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e65bd0b3-aa2b-4608-ac47-e6da32107806 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.153927 Aug 27 03:36:37.384416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 481/923] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:37 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:38.393491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:38.395133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:38.405433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.405874 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.406825 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.407407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.549761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:38.559680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:38.565260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:38.566511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d1d199d2-d3f9-49ac-8440-d8f89fd6677f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.178148 Aug 27 03:36:38.577410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 443/924] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:38 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:39.584987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:39.585666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:39.591772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:39.592223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:39.592992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:39.593425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:39.733178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:39.748361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:39.750514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:39.751935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-54f84253-cdfa-48c2-95f6-91b16f8717c8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.170565 Aug 27 03:36:39.752552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 482/925] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:39 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:40.771769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:40.772397 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:40.779111 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:40.779845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:40.780787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:40.781973 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:40.985138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:41.007134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:41.009574 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:41.011142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-17026ba2-3b6b-492d-816e-9ac8f2321066 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.243682 Aug 27 03:36:41.022713 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 444/926] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:40 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:42.033796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.034790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:42.045014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.045745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.047963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.048867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.229055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:42.238700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:42.240693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:42.242073 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-da8b0bd1-7d8e-4d71-92fc-2c593f1bdb67 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.215035 Aug 27 03:36:42.243220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 483/927] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:42 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:43.261625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:43.263543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:43.275018 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:43.276095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:43.277141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:43.279105 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:43.445297 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:43.451530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:43.453668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:43.455543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c3bb3754-6c67-40e8-88a7-18258f797733 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.197228 Aug 27 03:36:43.455543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 445/928] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:43 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:44.474486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:44.475099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:44.482333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:44.482930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:44.483918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:44.485366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:44.635211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:44.644496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:44.646217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:44.647383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7b747d28-e316-4780-afdd-e72f9cbecbb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.177418 Aug 27 03:36:44.647951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 484/929] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:44 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:45.666261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:45.666883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:45.673454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:45.674306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:45.675656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:45.676265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:45.833615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:45.842627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:45.845234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:45.846906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a5187e97-8ffa-474d-85fa-c0bdf78aab19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.184460 Aug 27 03:36:45.847751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 446/930] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:45 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:46.864882 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:46.865547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:46.871673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:46.872122 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:46.872894 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:46.873325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:47.061150 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:47.070317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:47.071810 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:47.072977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-47fddfdf-dcaa-4450-a5d5-29a554f1733c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1739 microversion: 2.20 time: 0.211922 Aug 27 03:36:47.073550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 485/931] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:46 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:48.091309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:48.091917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:48.098965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.099409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.100179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.100608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.284070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:48.292363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:48.293949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:48.295210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cf9e5d68-c263-4ece-9ea0-004be89d2e7f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1721 microversion: 2.20 time: 0.207636 Aug 27 03:36:48.295844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 447/932] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:48 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:49.314347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:49.314999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:49.320889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:49.321331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:49.322120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:49.322551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:49.445314 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:49.453733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:49.455274 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:49.456412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-34705ab8-3fd6-454e-b89d-a5e4d533f3e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1721 microversion: 2.20 time: 0.146242 Aug 27 03:36:49.456967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 486/933] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:49 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:50.475336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.475971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:50.482576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.483024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.483826 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.484759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.616604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.627071 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.628594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.629768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d13ced15-b846-4bfb-95e4-6ce41189dc1b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1724 microversion: 2.20 time: 0.158852 Aug 27 03:36:50.630378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 448/934] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:50 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:50.648419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15eda0c8-87e5-41c8-a542-d7958f308420"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:50.649476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:50.655492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.655949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.657399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.657835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.933172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d71350fd-b022-4a7d-b25a-c2b098f17134 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288340 Aug 27 03:36:50.933773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 487/935] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Aug 27 03:36:50 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:51.058856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:51.059511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:51.067076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.067559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.068337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.068773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.150517 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-45924c2d-a681-47af-92c8-2a0b0eaabfe5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action" status: 202 len: 0 microversion: 2.20 time: 0.095651 Aug 27 03:36:51.154507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 449/936] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:36:51 2021] POST /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:51.160561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:51.161177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:51.167709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.168126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.168915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.169464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.276311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-bea9611c-f737-482d-ab56-b856b23d962d req-0cef223d-1f57-45f5-a230-bac85570d632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "name": "network-vif-unplugged", "status": "completed", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:51.277891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:51.277891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:36:51.286856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-bea9611c-f737-482d-ab56-b856b23d962d req-0cef223d-1f57-45f5-a230-bac85570d632 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.287293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-bea9611c-f737-482d-ab56-b856b23d962d req-0cef223d-1f57-45f5-a230-bac85570d632 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.298325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.compute.server_external_events [req-bea9611c-f737-482d-ab56-b856b23d962d req-0cef223d-1f57-45f5-a230-bac85570d632 service nova] Unable to find a host for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5. Dropping event network-vif-unplugged {{(pid=109036) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 27 03:36:51.299216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-bea9611c-f737-482d-ab56-b856b23d962d req-0cef223d-1f57-45f5-a230-bac85570d632 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.166293 Aug 27 03:36:51.299807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 488/937] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 168 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 03:36:51.311368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:51.320014 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:51.321498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:51.322662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ff31665e-6812-449d-921b-8b916a2317b5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1750 microversion: 2.20 time: 0.166777 Aug 27 03:36:51.323226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 450/938] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:51 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:52.341118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:52.341734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:52.348517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:52.348962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:52.349735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:52.350204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:52.475653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:52.483844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:52.485896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:52.487057 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ef73033f-0505-488b-a908-8a206afe0cdb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1752 microversion: 2.20 time: 0.149698 Aug 27 03:36:52.487619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 489/939] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:52 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:53.505166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:53.505775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:53.511747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.512205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.512976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.513403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.717094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.726593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.728141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.729308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-486769f0-ee9d-4390-bcba-2e542f812631 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.227818 Aug 27 03:36:53.729873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 451/940] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:53 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:54.747441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:54.748027 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:54.753948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:54.754421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:54.755184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:54.755609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:54.893048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:54.901754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:54.903289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:54.904439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-87b1fadb-ae6e-4e4d-979d-ae3c0d18c788 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.160689 Aug 27 03:36:54.905002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 490/941] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:54 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:55.924843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:55.925601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:55.931981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:55.932427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:55.933209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:55.933640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:56.002144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:56.002849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:56.008724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:56.010042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:56.010042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:56.010446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:56.067871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.076580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.078088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.079324 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5518ae10-3fdd-49c0-a927-7caa8eb9020c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.158914 Aug 27 03:36:56.080059 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 491/942] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:55 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:56.108246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lazy-loading 'services' on Instance uuid 356e4fdd-62a5-42e5-bb50-a576d9338e22 {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:36:56.178366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fd1e6a4a-b7e5-481e-8382-287481bca9f5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-volume_attachments/cc90cf95-d75c-47d2-880b-f58a0c706fe7" status: 202 len: 0 microversion: 2.1 time: 0.296431 Aug 27 03:36:56.178962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 452/943] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:36:55 2021] DELETE /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-volume_attachments/cc90cf95-d75c-47d2-880b-f58a0c706fe7 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:57.096622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:57.097238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:57.103285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:57.103738 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:57.104524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:57.104961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:57.231043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:57.242107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:57.243816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:57.245105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-08abe930-0b27-4480-a1a8-f67cdb036823 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.152144 Aug 27 03:36:57.245799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 492/944] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:57 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:58.264808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:58.266128 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:58.272517 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:58.272961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:58.273745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:58.274245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:58.409225 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:58.418583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:58.420061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:58.421223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be60ea73-fa45-43f0-a8d0-e9a07a8fdd65 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.160757 Aug 27 03:36:58.422813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 453/945] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:58 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:59.440800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.441457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:59.447492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:59.447939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:59.448723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:59.449156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:59.586969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:59.595571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:59.597131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:59.598303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b466c7fd-1c9e-459d-a233-d1fd0880fa20 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.161829 Aug 27 03:36:59.599858 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 493/946] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:59 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:00.617222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:00.617845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:00.623768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:00.624206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:00.625547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:00.625925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:00.756635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:00.765553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:00.767118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:00.768298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e89a0d9d-5af0-4b19-91c9-29aa74551779 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.154806 Aug 27 03:37:00.768866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 454/947] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:00 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:01.787189 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:01.788015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:01.794112 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:01.794556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:01.795344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:01.795759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:01.931207 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:01.945601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:01.947655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:01.948867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-58516212-61c3-43e0-859b-63d31554d6ea tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.166486 Aug 27 03:37:01.949676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 494/948] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:01 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:02.968062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.968821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:02.975542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:02.975983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:02.976755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:02.977181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:03.107008 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:03.116233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:03.117727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:03.118929 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2174cc6d-34f3-4813-977d-36d3b31955e6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.155016 Aug 27 03:37:03.121120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 455/949] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:02 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:04.139139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:04.141210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:04.147407 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:04.147845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:04.148610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:04.149079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:04.286347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.295350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.297567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.299686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b240271a-af9b-4ace-a0e3-0041badc7d62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.164578 Aug 27 03:37:04.300634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 495/950] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:04 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:05.319462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:05.320478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:05.326285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:05.326738 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:05.327617 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:05.328829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:05.472271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:05.480836 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:05.482357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:05.483583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c2077fef-1614-450e-92c2-a27060f4626e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.167911 Aug 27 03:37:05.485090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 456/951] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:05 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:06.501673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.502325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:06.508118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.508548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.509293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.509724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.634243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:06.642837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:06.644342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:06.645482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d2aff82d-4e62-4230-9354-cac481d39a90 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.147548 Aug 27 03:37:06.646193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 496/952] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:06 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:07.663904 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.664503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:07.670293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:07.670728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:07.672145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:07.672679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:07.790862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.799504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.800980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.802132 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-742716d7-fafb-45f0-916a-92449a84201d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.141912 Aug 27 03:37:07.802685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 457/953] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:07 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:08.821768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:08.822401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:08.829480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:08.829973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:08.830816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:08.831270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:08.964130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:08.972800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:08.974294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:08.975419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f41e1727-fa6b-48e1-8561-794d4fea84b7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.158032 Aug 27 03:37:08.975980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 497/954] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:08 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:09.997749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:09.999686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:10.010933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:10.011580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:10.012556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:10.013236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:10.159688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.167794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.169261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.170419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-afb2060f-875c-4081-af9c-89b548c2b6e8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.179713 Aug 27 03:37:10.170968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 458/955] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:09 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:11.086048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e41c6225-3119-449e-ab37-df67222bbc78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:11.092931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e41c6225-3119-449e-ab37-df67222bbc78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.093508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e41c6225-3119-449e-ab37-df67222bbc78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.118212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e41c6225-3119-449e-ab37-df67222bbc78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Going to try to stop instance {{(pid=109036) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 03:37:11.165085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e41c6225-3119-449e-ab37-df67222bbc78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 202 len: 0 microversion: 2.1 time: 0.082951 Aug 27 03:37:11.165678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 498/956] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:37:11 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:11.173432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.174145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:11.180012 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.180687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.181484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.181890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.190833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.191527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:11.198085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.198085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.198779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.199218 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.376632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.382947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.385263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-192d2a9a-960c-469c-ad90-b57b318d0e68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.215370 Aug 27 03:37:11.385844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 459/957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:11 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:11.392117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.393969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.395330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f48f4a60-01aa-48db-82eb-d496e4772112 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.209554 Aug 27 03:37:11.395912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 499/958] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:11 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:12.402217 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.402819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:12.410811 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.411251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.412065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.412531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.414785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.415391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:12.421498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.421935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.422840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.423684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.605499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.608567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.618462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bb821415-9301-429f-8679-89623ef1bef7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.219439 Aug 27 03:37:12.619689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 460/959] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:12 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:12.623182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.624757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.625951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dcdb27d9-c115-4fb9-80c4-067ba75b507b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.214742 Aug 27 03:37:12.626534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 500/960] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:12 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:13.637587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.638241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:13.645214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.645797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:13.645904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:13.646042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:13.646791 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:13.647224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:13.653939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:13.654443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:13.655716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:13.656004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:13.843805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.847711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.852827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.854335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.854952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-426ea593-d565-4ebd-a901-c2ad887dab62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.221144 Aug 27 03:37:13.855476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74354cc5-aed6-47e9-8378-9377510deca2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.214437 Aug 27 03:37:13.855629 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 461/961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:13 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:13.856018 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 501/962] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:13 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:37:14.872547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:14.873100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:14.873512 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:14.874172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:14.879720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:14.880162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:14.880621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:14.880923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:14.881073 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:14.881355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:14.881836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:14.882328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:15.064862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.069848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.072414 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f22e68f7-9aa4-4bcd-be1e-a7cb55c9bf5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.203752 Aug 27 03:37:15.072997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 462/963] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:14 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:15.078093 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.079579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.081392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8355ec08-3f36-4ffc-8d85-2b5f072ddb7a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.211415 Aug 27 03:37:15.081933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 502/964] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:14 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:16.090714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:16.091332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:16.097374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:16.097844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:16.098678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:16.098859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:16.099301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:16.099464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:16.105142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:16.105575 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:16.106365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:16.106790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:16.281737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.287955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.289714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-389a6583-76a9-4a11-91f9-f32b91d2288b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.202655 Aug 27 03:37:16.290322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 463/965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:16 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:16.296787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.298320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.300195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d99f6c75-9a5f-480a-b755-d9186af82dfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.205263 Aug 27 03:37:16.300784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 503/966] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:16 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:17.307276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.307927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:17.314099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:17.315118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:17.315941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:17.316562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:17.319967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.320583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:17.326661 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:17.327108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:17.328083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:17.328517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:17.508320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.510976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.515516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eef536e0-6f5f-4169-a896-c0ce834cc1f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.212088 Aug 27 03:37:17.516176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 464/967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:17 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:17.519962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.521469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.522659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-98e0fa2d-d63a-40aa-bbdc-efff3341ace0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.206525 Aug 27 03:37:17.523203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 504/968] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:17 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:18.534889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.535509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:18.539888 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.540500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:18.541609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:18.542100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:18.542878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:18.543312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:18.546154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:18.546597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:18.547354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:18.547783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:18.728833 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.736738 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.736888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-913b43f8-a314-49be-a606-a982a2947633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.205886 Aug 27 03:37:18.737565 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 465/969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:18 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:18.746146 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.747756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.749142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6e4566d9-ee3e-4242-a06c-f7b8d26445f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.212922 Aug 27 03:37:18.749754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 505/970] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:18 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:19.381052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-cfda2c1c-262c-4c2e-8221-fbebf968d92f req-4121f1ea-72d0-4020-864e-ea5bdf4a8948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:19.382901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:19.382901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:37:19.390849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-cfda2c1c-262c-4c2e-8221-fbebf968d92f req-4121f1ea-72d0-4020-864e-ea5bdf4a8948 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.391291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-cfda2c1c-262c-4c2e-8221-fbebf968d92f req-4121f1ea-72d0-4020-864e-ea5bdf4a8948 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.402905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-cfda2c1c-262c-4c2e-8221-fbebf968d92f req-4121f1ea-72d0-4020-864e-ea5bdf4a8948 service nova] Creating event network-vif-plugged:4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8 for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 on hv-cinder-77398 Aug 27 03:37:19.408411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-cfda2c1c-262c-4c2e-8221-fbebf968d92f req-4121f1ea-72d0-4020-864e-ea5bdf4a8948 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031527 Aug 27 03:37:19.409384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 466/971] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:19.754797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:19.755459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:19.761289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.761731 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.762528 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.762972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.772063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:19.772757 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:19.778987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.779429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.780195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.780616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.991328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:19.998529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bfbaee5f-5a0e-4e5c-a8bd-8dfa99082b5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.248138 Aug 27 03:37:20.009479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 506/972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:19 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:20.009914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:20.009914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:20.011063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:20.012212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b98890ca-8e6d-4453-9b16-08ebeda44d7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.245363 Aug 27 03:37:20.012770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 467/973] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:19 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:21.018834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:21.019467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:21.026403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:21.027031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:21.028187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:21.028874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:21.030981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:21.031589 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:21.039808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:21.040437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:21.041899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:21.042365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:21.226336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.231053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.234921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.237298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.239846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dcbd2715-82e8-47af-8e98-1f1f19e44e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.226282 Aug 27 03:37:21.240437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 507/974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:21 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:21.243132 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3a3e2ba7-206c-4dc8-832a-fe0847cc46f0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1808 microversion: 2.20 time: 0.216262 Aug 27 03:37:21.243711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 468/975] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:21 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:22.258149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.258745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:22.262129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.262812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:22.264780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:22.265224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:22.265997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:22.266456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:22.270058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:22.270518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:22.271294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:22.271731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:22.447952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:22.450461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:22.456064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dfd9872f-daec-415c-a776-ff2ac4e577a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.201132 Aug 27 03:37:22.456848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 508/976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:22 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:22.460367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:22.461863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:22.463039 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-70ef9e64-c040-40a8-88dd-18511583e961 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1795 microversion: 2.20 time: 0.204829 Aug 27 03:37:22.463585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 469/977] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:37:22 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1795 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:37:23.473504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:23.474254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:23.480084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:23.480525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:23.481286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:23.481715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:23.604488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:23.612352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-86aedd2a-75b2-46f2-81e9-11f1d77b4d9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.143067 Aug 27 03:37:23.613003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 509/978] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:23 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:24.629644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:24.630281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:24.636687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:24.637133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:24.637907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:24.638378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:24.764662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:24.772531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-57c0c1b5-457f-4a59-8287-d29a45d856e2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.146884 Aug 27 03:37:24.773100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 470/979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:24 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:25.789146 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:25.789787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:25.795553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:25.795986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:25.796730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:25.797151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:25.918940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:25.926281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-79b0b3c5-3289-4add-92a7-429b8c885e98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.140832 Aug 27 03:37:25.926839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 510/980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:25 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:26.943690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:26.944253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:26.950245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:26.950718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:26.951476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:26.951899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:27.074402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:27.082318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7cf64530-8406-47df-bc30-45767636b2ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.142509 Aug 27 03:37:27.082886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 471/981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:26 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:28.098991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:28.099607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:28.105471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:28.105915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:28.106712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:28.107144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:28.231564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:28.238824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3cd30eee-12fd-48a5-aaf8-89214d677104 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.144145 Aug 27 03:37:28.239389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 511/982] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:28 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:29.256722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:29.257337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:29.263261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:29.263710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:29.264480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:29.264913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:29.390794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:29.398356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-698966b7-d08e-46f3-a270-ca02da3f2b08 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.145827 Aug 27 03:37:29.398942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 472/983] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:29 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:30.414936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:30.415539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:30.421571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:30.422046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:30.422847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:30.423332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:30.557095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:30.564183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8cfe3500-5fb6-4acd-a010-66291dbd8140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.152854 Aug 27 03:37:30.564943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 512/984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:30 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:31.581934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:31.582573 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:31.588495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:31.588934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:31.589691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:31.590148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:31.714036 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:31.721550 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5002ab76-12b5-48cb-9271-ff0dfed2cbb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.143329 Aug 27 03:37:31.722151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 473/985] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:31 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:32.743922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:32.744529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:32.750588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:32.751039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:32.752354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:32.752786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:32.877298 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:32.884999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-27823f35-9d6d-4d66-b0df-82cb9407dde6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.144677 Aug 27 03:37:32.885584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 513/986] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:32 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:33.902119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:33.902692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:33.909115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:33.909558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:33.910353 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:33.910782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:34.032099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:34.040260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-408ecf60-93b0-42bf-bd13-cc0b86f22fce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.141920 Aug 27 03:37:34.040829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 474/987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:33 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:35.058205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:35.058986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:35.066422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:35.066869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:35.067642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:35.068073 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:35.192871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:35.200301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c9864892-0e61-4c1c-b30f-6d4f5ab2b605 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.145852 Aug 27 03:37:35.200868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 514/988] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:35 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:36.217693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:36.218320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:36.225345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:36.225793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:36.226644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:36.227080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:36.348332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:36.355663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee1825f5-67ac-4185-9b8d-a3e7db15f52d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1679 microversion: 2.1 time: 0.141666 Aug 27 03:37:36.356231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 475/989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:36 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1679 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:37.375600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:37.376238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:37.383000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.383450 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:37.384220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.384653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:37.507032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:37.514261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ea2cd265-63f6-48fa-9a4c-0e04896643da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1656 microversion: 2.1 time: 0.142338 Aug 27 03:37:37.514833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 515/990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:37 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1656 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:37.530895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4279488c-352c-476f-a249-57649d510149 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:37.536967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4279488c-352c-476f-a249-57649d510149 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.537411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4279488c-352c-476f-a249-57649d510149 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:37.560383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4279488c-352c-476f-a249-57649d510149 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Going to try to start instance {{(pid=109037) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 03:37:37.607564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4279488c-352c-476f-a249-57649d510149 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action" status: 202 len: 0 microversion: 2.1 time: 0.080229 Aug 27 03:37:37.611819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 476/991] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:37:37 2021] POST /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:37.617191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:37.617817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:37.624344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.624906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:37.625782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.626204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:37.778249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:37.786328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4ae4a9a3-8233-4443-87c3-f8f3efed0ebb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1665 microversion: 2.1 time: 0.172762 Aug 27 03:37:37.787098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 516/992] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:37 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:38.804085 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:38.804781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:38.811186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:38.811566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:38.812354 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:38.812792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:38.946801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:38.956216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-33a9afc5-b4de-4b23-860f-bb798e4a025d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1665 microversion: 2.1 time: 0.156103 Aug 27 03:37:38.956807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 477/993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:38 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:39.825402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-220929260"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:39.825957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:39.832343 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:39.832789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:39.833551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:39.833978 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:39.955305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.network.security_group_api [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Removing security group 20df78b8-f19f-44ca-88d2-32ccf6d6ec47 from port ab86934c-3c7f-4ee5-8361-ae8500899a8b Aug 27 03:37:39.973728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:39.974401 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:39.980230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:39.980677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:39.981456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:39.981891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:40.185296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:40.193867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4e0c269c-a944-4a19-9dc4-caefcd6d9dd1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1669 microversion: 2.1 time: 0.224777 Aug 27 03:37:40.194490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 478/994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:39 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:40.634594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c0889ab9-49be-4e95-abdf-1c2846376819 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/action" status: 202 len: 0 microversion: 2.1 time: 0.812205 Aug 27 03:37:40.638389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 517/995] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:37:39 2021] POST /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:37:40.721316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-c59047b6-eb64-4480-80c2-2fa0c7f008f3 req-307ee5b2-379b-4044-8f2e-bbe4e7d09af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:40.725416 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:40.725416 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:37:40.733744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c59047b6-eb64-4480-80c2-2fa0c7f008f3 req-307ee5b2-379b-4044-8f2e-bbe4e7d09af3 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:40.734179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c59047b6-eb64-4480-80c2-2fa0c7f008f3 req-307ee5b2-379b-4044-8f2e-bbe4e7d09af3 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:40.747518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-c59047b6-eb64-4480-80c2-2fa0c7f008f3 req-307ee5b2-379b-4044-8f2e-bbe4e7d09af3 service nova] Creating event network-changed:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:37:40.759360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-c59047b6-eb64-4480-80c2-2fa0c7f008f3 req-307ee5b2-379b-4044-8f2e-bbe4e7d09af3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120145 Aug 27 03:37:40.760604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 479/996] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:42.040947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:42.041490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:42.047771 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.048288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.049341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.049870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.123348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-5b3e7c5b-8e5f-4bd4-b975-94ab8bc8a282 req-cc4c3c7a-96cb-49e4-bf56-e643cb55dbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:42.125837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:42.125837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:37:42.134316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-5b3e7c5b-8e5f-4bd4-b975-94ab8bc8a282 req-cc4c3c7a-96cb-49e4-bf56-e643cb55dbe0 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.135222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-5b3e7c5b-8e5f-4bd4-b975-94ab8bc8a282 req-cc4c3c7a-96cb-49e4-bf56-e643cb55dbe0 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.150517 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-5b3e7c5b-8e5f-4bd4-b975-94ab8bc8a282 req-cc4c3c7a-96cb-49e4-bf56-e643cb55dbe0 service nova] Creating event network-changed:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:37:42.158246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-5b3e7c5b-8e5f-4bd4-b975-94ab8bc8a282 req-cc4c3c7a-96cb-49e4-bf56-e643cb55dbe0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117575 Aug 27 03:37:42.159357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 480/997] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:42.163155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lazy-loading 'services' on Instance uuid 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:37:42.235639 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cb9aebe9-4914-49bc-a6ed-3b319b62e141 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments/30242294-a132-4d9b-b58b-a49845b4d665" status: 202 len: 0 microversion: 2.1 time: 0.198345 Aug 27 03:37:42.240279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 518/998] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:37:42 2021] DELETE /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments/30242294-a132-4d9b-b58b-a49845b4d665 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:42.246772 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:42.248120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:42.255226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.256092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.257237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.258067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.294471 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2a1c6f1d-5fb7-4a45-86e7-cb3c64691107 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052326 Aug 27 03:37:42.295046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 481/999] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:37:42 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:37:43.307796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:43.308997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:43.316519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.316998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.317726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.318201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.346887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1fdc48f0-6c00-4903-9271-1ad1c64b709c tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043239 Aug 27 03:37:43.347468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 519/1000] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:37:43 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:37:43.357078 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:43.357618 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:43.364159 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.364609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.365380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.365812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.452093 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] HTTP exception thrown: Instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 is not attached to volume 30242294-a132-4d9b-b58b-a49845b4d665 Aug 27 03:37:43.452654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Returning 404 to user: Instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 is not attached to volume 30242294-a132-4d9b-b58b-a49845b4d665 {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:43.453480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1d29e5bb-cf6f-48ea-ba9a-543917458c26 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments/30242294-a132-4d9b-b58b-a49845b4d665" status: 404 len: 154 microversion: 2.1 time: 0.100242 Aug 27 03:37:43.454038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 482/1001] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:37:43 2021] DELETE /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4/os-volume_attachments/30242294-a132-4d9b-b58b-a49845b4d665 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:44.587970 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.588459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:44.594273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:44.594720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:44.595492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:44.595998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:44.623365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:37:44.697374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ef60316e-0874-4072-97be-0edab66ee9a6 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 204 len: 0 microversion: 2.1 time: 0.112671 Aug 27 03:37:44.697964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 520/1002] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:37:44 2021] DELETE /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:44.708022 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.708748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:44.715153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:44.715598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:44.716370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:44.716804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:44.840038 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:44.847360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7a6a0fc9-a27f-4683-b0d3-298f0df2cdf0 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1551 microversion: 2.1 time: 0.145133 Aug 27 03:37:44.847928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 483/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:44 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1551 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:45.865051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:45.865671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:45.871597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:45.872046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:45.872810 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:45.873243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:45.996135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:46.004083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-147eb7d2-7163-4623-945d-dca0e8f79031 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1551 microversion: 2.1 time: 0.143321 Aug 27 03:37:46.004653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 521/1004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:45 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1551 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:47.020878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:47.021497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:47.027434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:47.027887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:47.028658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:47.029087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:47.220371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0793093dbb4ab18379588ad441b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04c0694a50c4533859c8db8a7269b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:47.229224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5bffda63-0143-41a3-83e2-d0a112790a75 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 200 len: 1551 microversion: 2.1 time: 0.211967 Aug 27 03:37:47.229804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 484/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:47 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 1551 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:47.484830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-74852313-dc70-46f4-9ed2-d5942a6d5693 req-bcaa6d83-9ed3-4622-aade-e7ece0f94273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1e4b2e-c699-43b6-b673-f82f082b2bb4", "name": "network-vif-deleted", "tag": "ab86934c-3c7f-4ee5-8361-ae8500899a8b"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:47.486732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:47.486732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:37:47.495117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-74852313-dc70-46f4-9ed2-d5942a6d5693 req-bcaa6d83-9ed3-4622-aade-e7ece0f94273 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:47.495557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-74852313-dc70-46f4-9ed2-d5942a6d5693 req-bcaa6d83-9ed3-4622-aade-e7ece0f94273 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:47.507054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-74852313-dc70-46f4-9ed2-d5942a6d5693 req-bcaa6d83-9ed3-4622-aade-e7ece0f94273 service nova] Creating event network-vif-deleted:ab86934c-3c7f-4ee5-8361-ae8500899a8b for instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 on hv-cinder-77398 Aug 27 03:37:47.512244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-74852313-dc70-46f4-9ed2-d5942a6d5693 req-bcaa6d83-9ed3-4622-aade-e7ece0f94273 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030985 Aug 27 03:37:47.512803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 522/1006] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:48.348685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:48.349284 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] [instance: 6b1e4b2e-c699-43b6-b673-f82f082b2bb4] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:48.355176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:48.355625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:48.356404 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:48.356832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:48.371751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] HTTP exception thrown: Instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 could not be found. Aug 27 03:37:48.372363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Returning 404 to user: Instance 6b1e4b2e-c699-43b6-b673-f82f082b2bb4 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:48.373214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-55fd0466-aefe-4050-8753-43dffac53227 tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4" status: 404 len: 111 microversion: 2.1 time: 0.130734 Aug 27 03:37:48.373763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 485/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:48 2021] GET /compute/v2.1/servers/6b1e4b2e-c699-43b6-b673-f82f082b2bb4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:48.382824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0ff6bfca-093f-49a7-8464-5b62de86dddd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] Calling method '.version_select at 0x7fb1306c7c10>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:48.404783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0ff6bfca-093f-49a7-8464-5b62de86dddd tempest-TestMinimumBasicScenario-173741556 tempest-TestMinimumBasicScenario-173741556-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-56621486" status: 202 len: 0 microversion: 2.1 time: 0.026434 Aug 27 03:37:48.405366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 523/1008] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Aug 27 03:37:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-56621486 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:04.488801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:04.493348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:04.498835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:04.499384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:04.503132 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:04.503132 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:04.536638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:38:04.620731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0182aa34-3a9b-49df-b42c-095b20d7c8a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "DELETE /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 204 len: 0 microversion: 2.1 time: 0.136601 Aug 27 03:38:04.621296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 486/1009] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:38:04 2021] DELETE /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:38:04.629772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:04.630524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:04.636701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:04.637139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:04.637904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:04.638360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:04.777438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:04.787693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bcd6e29a-7022-4673-b882-38a824d19285 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1576 microversion: 2.1 time: 0.162028 Aug 27 03:38:04.788288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 524/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:04 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:05.807143 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:05.807750 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:05.813788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:05.814254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:05.815006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:05.815429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:05.941321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:05.948521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e8c6b84f-c58b-4afb-a7ce-a226c64878da tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1576 microversion: 2.1 time: 0.145461 Aug 27 03:38:05.949092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 487/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:05 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:06.965687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:06.966333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:06.971997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:06.973074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:06.973839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:06.974290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:07.191395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:07.200061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d78f043d-adeb-4b58-9a5a-5d3de5b0b618 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1576 microversion: 2.1 time: 0.237963 Aug 27 03:38:07.200644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 525/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:06 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:07.420519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-e2f54f97-4dc5-4f03-b6a5-81fcec7a666d req-c2589185-3c5e-4914-b3e7-4f06a3c27946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259f7cfe-9ee5-44ec-b227-d524587c5600", "name": "network-vif-deleted", "tag": "12277069-4498-4469-9aee-a13eb400f6d3"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:07.422427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:07.422427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:38:07.430597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-e2f54f97-4dc5-4f03-b6a5-81fcec7a666d req-c2589185-3c5e-4914-b3e7-4f06a3c27946 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:07.431030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-e2f54f97-4dc5-4f03-b6a5-81fcec7a666d req-c2589185-3c5e-4914-b3e7-4f06a3c27946 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:07.443936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-e2f54f97-4dc5-4f03-b6a5-81fcec7a666d req-c2589185-3c5e-4914-b3e7-4f06a3c27946 service nova] Creating event network-vif-deleted:12277069-4498-4469-9aee-a13eb400f6d3 for instance 259f7cfe-9ee5-44ec-b227-d524587c5600 on hv-cinder-77398 Aug 27 03:38:07.449265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-e2f54f97-4dc5-4f03-b6a5-81fcec7a666d req-c2589185-3c5e-4914-b3e7-4f06a3c27946 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032522 Aug 27 03:38:07.450656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 488/1013] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:08.216580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:08.217863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:08.225048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:08.225499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:08.226376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:08.227053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:08.264902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:08.265516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:08.266065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lazy-loading 'fault' on Instance uuid 259f7cfe-9ee5-44ec-b227-d524587c5600 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:38:08.311190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:08.319950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6820d6c2-7adf-4d23-bece-909e503166aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 200 len: 1230 microversion: 2.1 time: 0.106874 Aug 27 03:38:08.330199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 526/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:08 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:09.338075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:09.338821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:09.345478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:09.345926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:09.346818 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:09.348019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:09.361526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] HTTP exception thrown: Instance 259f7cfe-9ee5-44ec-b227-d524587c5600 could not be found. Aug 27 03:38:09.362141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Returning 404 to user: Instance 259f7cfe-9ee5-44ec-b227-d524587c5600 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:38:09.362985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-befcdb1e-fb67-4b58-b3a1-44135d677f51 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 404 len: 111 microversion: 2.1 time: 0.029085 Aug 27 03:38:09.363842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 489/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:09 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:09.463920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1240167874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-699246540", "security_groups": [{"name": "tempest-secgroup-smoke-1821316026"}], "block_device_mapping_v2": [{"uuid": "79724246-2e53-49cb-9c29-d9f587cfec46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc4f9fa9-5953-43ff-b4f3-e98c9fc78c8d"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:09.580778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] validate_networks() for [('fc4f9fa9-5953-43ff-b4f3-e98c9fc78c8d', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:38:10.032385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:38:10.032838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:38:10.033315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:38:10.033728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:38:10.034188 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:38:10.043526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:10.043977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:10.044775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:10.045209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:10.061936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:10.067342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Getting quotas for user 6883257742b64642887adffbe4f0a725 and project 93c77e3c5a0d4923a18d3f98ccb523a8. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:10.126209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:38:10.128321 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79724246-2e53-49cb-9c29-d9f587cfec46',volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:38:10.257232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-59f0de09-feb3-4637-b991-335a1de17c9d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800732 Aug 27 03:38:10.257900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 527/1016] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:38:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:38:10.267760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-de49ecb0-e992-4364-a6c8-89f3f8191b4a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:10.268374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-de49ecb0-e992-4364-a6c8-89f3f8191b4a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:10.321251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-de49ecb0-e992-4364-a6c8-89f3f8191b4a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:10.327606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-de49ecb0-e992-4364-a6c8-89f3f8191b4a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1094 microversion: 2.1 time: 0.063476 Aug 27 03:38:10.328172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 490/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:10 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:11.343975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-99cb3dda-123e-4c0b-b5e7-1c3ac7562092 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:11.344579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-99cb3dda-123e-4c0b-b5e7-1c3ac7562092 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:11.400957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-99cb3dda-123e-4c0b-b5e7-1c3ac7562092 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:11.407427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-99cb3dda-123e-4c0b-b5e7-1c3ac7562092 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1094 microversion: 2.1 time: 0.067059 Aug 27 03:38:11.407982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 528/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:11 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:12.425001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:12.426323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:12.432492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:12.432930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:12.433920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:12.434593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:12.509395 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:12.516654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-27f15f70-4f97-44fe-a9a6-068ade240f97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1210 microversion: 2.1 time: 0.095666 Aug 27 03:38:12.517233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 491/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:12 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:13.535905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:13.537273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:13.559262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:13.562550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:13.563792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:13.564238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:13.739402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-a96afd5f-6e69-450d-8e08-02e162729ec2 req-f3ea4330-ed2b-4cd1-a366-0b0a54a31aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a03aa5-2406-4897-ab82-ed8c62cdab4c", "tag": "c2519256-b76c-4991-bea8-ecb5807c4769"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:13.741902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:13.741902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:38:13.754829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-a96afd5f-6e69-450d-8e08-02e162729ec2 req-f3ea4330-ed2b-4cd1-a366-0b0a54a31aae service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:13.755344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-a96afd5f-6e69-450d-8e08-02e162729ec2 req-f3ea4330-ed2b-4cd1-a366-0b0a54a31aae service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:13.769534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-a96afd5f-6e69-450d-8e08-02e162729ec2 req-f3ea4330-ed2b-4cd1-a366-0b0a54a31aae service nova] Creating event network-changed:c2519256-b76c-4991-bea8-ecb5807c4769 for instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c on hv-cinder-77398 Aug 27 03:38:13.775144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-a96afd5f-6e69-450d-8e08-02e162729ec2 req-f3ea4330-ed2b-4cd1-a366-0b0a54a31aae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040857 Aug 27 03:38:13.776063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 492/1020] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:13.837772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:13.845812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-53688729-9ba7-4b17-a82c-752a6a124359 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.313930 Aug 27 03:38:13.846431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 529/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:13 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:14.864689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:14.865395 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:14.871398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:14.871843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:14.872614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:14.873047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:15.345300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:15.353105 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7c89b4ea-0131-480c-af91-d006988ae535 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.493173 Aug 27 03:38:15.353679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 493/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:14 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:16.369993 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:16.370663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:16.376659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:16.377107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:16.377905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:16.378367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:16.506608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:16.514123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-746d38b8-c81e-4c5a-bedd-5181674c375c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.147738 Aug 27 03:38:16.514702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 530/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:16 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:17.531848 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:17.532518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:17.538676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:17.539118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:17.539894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:17.540324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:17.671926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:17.679661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b6737b80-a1b0-43ec-a63c-75bef9238cda tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.151437 Aug 27 03:38:17.680242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 494/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:17 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:18.697248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:18.697854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:18.703795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:18.704243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:18.705009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:18.705444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:18.834419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:18.841700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b374aaec-c547-4ebc-a70c-1abb098c5f4f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.148126 Aug 27 03:38:18.842297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 531/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:18 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:19.859424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:19.859974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:19.866089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:19.866544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:19.867430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:19.867859 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:19.996293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:20.004203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d8376f32-1c33-4a2e-9b6b-862981c84427 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.148026 Aug 27 03:38:20.004769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 495/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:19 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:21.021153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:21.021773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:21.028768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:21.029291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:21.030636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:21.031353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:21.176289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:21.183677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-91bbf91a-b995-42ed-9841-a98e598e9354 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.166713 Aug 27 03:38:21.184255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 532/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:21 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:22.200706 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:22.201265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:22.207704 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:22.208153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:22.208936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:22.209403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:22.334216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:22.341388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0dcb5ed6-1c94-4623-a2f6-f27d6686ab91 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.144630 Aug 27 03:38:22.341949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 496/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:22 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:23.358704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:23.359346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:23.365996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:23.366495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:23.367289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:23.367715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:23.485011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:23.492870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-18876ded-30ab-4a67-b622-19bda0f0237c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.137834 Aug 27 03:38:23.493433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 533/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:23 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:23.768630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-93121b6a-7b96-409a-aa99-51d21f85c3dd req-fb8d6b72-7f2c-4c54-bbc4-bfa7476519aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a03aa5-2406-4897-ab82-ed8c62cdab4c", "name": "network-vif-plugged", "status": "completed", "tag": "c2519256-b76c-4991-bea8-ecb5807c4769"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:23.770644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:23.770644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:38:23.778775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-93121b6a-7b96-409a-aa99-51d21f85c3dd req-fb8d6b72-7f2c-4c54-bbc4-bfa7476519aa service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:23.778775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-93121b6a-7b96-409a-aa99-51d21f85c3dd req-fb8d6b72-7f2c-4c54-bbc4-bfa7476519aa service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:23.790402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-93121b6a-7b96-409a-aa99-51d21f85c3dd req-fb8d6b72-7f2c-4c54-bbc4-bfa7476519aa service nova] Creating event network-vif-plugged:c2519256-b76c-4991-bea8-ecb5807c4769 for instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c on hv-cinder-77398 Aug 27 03:38:23.795407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-93121b6a-7b96-409a-aa99-51d21f85c3dd req-fb8d6b72-7f2c-4c54-bbc4-bfa7476519aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030477 Aug 27 03:38:23.796001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 497/1030] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:24.509747 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:24.510386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:24.516371 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:24.516814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:24.517571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:24.518001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:24.646718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:24.654137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cb378dab-2e88-471d-a896-6ab8c16db48c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1266 microversion: 2.1 time: 0.148001 Aug 27 03:38:24.654707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 534/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:24 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:25.671496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:25.672220 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:25.678730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:25.679181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:25.679946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:25.680379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:25.802725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:25.810137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b2d3a741-54b6-47a6-bc1c-4042f29f6d7a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1453 microversion: 2.1 time: 0.142914 Aug 27 03:38:25.810637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 498/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:25 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:25.827369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:25.827975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:25.834555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:25.834997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:25.835760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:25.836190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:25.960701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:25.967895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-db0d92a4-484e-466e-9652-b39f5382c138 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1453 microversion: 2.1 time: 0.144124 Aug 27 03:38:25.968461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 535/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:25 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:26.617096 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:26.617590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:26.623483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:26.623923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:26.624702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:26.625129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:26.656633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c08957ac-209b-4b0a-a5b9-21888dec5ed8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments/15eda0c8-87e5-41c8-a542-d7958f308420" status: 200 len: 194 microversion: 2.20 time: 0.207270 Aug 27 03:38:26.662884 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 499/1034] 10.222.0.48 () {60 vars in 1454 bytes} [Fri Aug 27 03:38:26 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments/15eda0c8-87e5-41c8-a542-d7958f308420 => generated 194 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:38:26.732888 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:26.733383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:26.740424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:26.740863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:26.741652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:26.742113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:26.832966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lazy-loading 'services' on Instance uuid bef4e7c3-65e5-4239-b56a-84761b4b7cc5 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:38:26.902251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0a93bb6c-d880-4148-8418-1e00c5a57f62 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments/15eda0c8-87e5-41c8-a542-d7958f308420" status: 202 len: 0 microversion: 2.20 time: 0.173215 Aug 27 03:38:26.903017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 536/1035] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Aug 27 03:38:26 2021] DELETE /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments/15eda0c8-87e5-41c8-a542-d7958f308420 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:38:26.917522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:26.918547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:26.924535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:26.929458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:26.930384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:26.931013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:26.974669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3e742917-9885-48e5-b9fb-ce10ab9b95a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066946 Aug 27 03:38:26.979142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 500/1036] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Aug 27 03:38:26 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:38:27.881246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-8dfad0cf-2e48-49ed-a62a-da86c9cd5cee req-06be57bd-c893-47ec-9841-480e124b3d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a03aa5-2406-4897-ab82-ed8c62cdab4c", "tag": "c2519256-b76c-4991-bea8-ecb5807c4769"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:27.883517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:27.883517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:27.892952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-8dfad0cf-2e48-49ed-a62a-da86c9cd5cee req-06be57bd-c893-47ec-9841-480e124b3d27 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:27.893691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-8dfad0cf-2e48-49ed-a62a-da86c9cd5cee req-06be57bd-c893-47ec-9841-480e124b3d27 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:27.908507 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-8dfad0cf-2e48-49ed-a62a-da86c9cd5cee req-06be57bd-c893-47ec-9841-480e124b3d27 service nova] Creating event network-changed:c2519256-b76c-4991-bea8-ecb5807c4769 for instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c on hv-cinder-77398 Aug 27 03:38:27.914223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-8dfad0cf-2e48-49ed-a62a-da86c9cd5cee req-06be57bd-c893-47ec-9841-480e124b3d27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037174 Aug 27 03:38:27.914828 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 537/1037] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:27.987007 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:27.988346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:27.994168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:27.994607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:27.995388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:27.995781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:28.026696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-18c85f1e-8fa5-4ecd-9d11-a3f10afd9c8f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043564 Aug 27 03:38:28.027260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 501/1038] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Aug 27 03:38:27 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:28.090466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:28.091136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:28.097825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:28.098319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:28.099085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:28.099511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:28.125239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:38:28.211244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a031229a-8c10-4c2c-9bac-6f731e5dbe75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 204 len: 0 microversion: 2.20 time: 0.124395 Aug 27 03:38:28.211880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 538/1039] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Aug 27 03:38:28 2021] DELETE /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:38:28.219822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:28.220554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:28.228200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:28.228940 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:28.230163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:28.230814 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:28.440491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:28.449756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:28.453293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:28.454642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-95d50ecb-c835-4d70-a051-170dcc5ffb33 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.238518 Aug 27 03:38:28.455203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 502/1040] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:28 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:29.474195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:29.474868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:29.481013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:29.481461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:29.482269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:29.482717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:29.606373 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:29.614284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:29.615780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:29.616920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4777b302-6d8d-4cf2-927d-e6305f423a75 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.147175 Aug 27 03:38:29.617480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 539/1041] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:29 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:30.637493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:30.638631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:30.647557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:30.648278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:30.649564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:30.650250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:30.918585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:30.927718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:30.929250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:30.930521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5bf5922b-4bfd-4447-bad0-06b83de5e1fb tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 200 len: 1723 microversion: 2.20 time: 0.298301 Aug 27 03:38:30.931304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 503/1042] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:30 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:31.314476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-e43b2250-e44b-4b59-8662-35d19465db7a req-c178dbfa-3c9d-43e4-9ee3-3fb46409b5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef4e7c3-65e5-4239-b56a-84761b4b7cc5", "name": "network-vif-deleted", "tag": "4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:31.316308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:31.316308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:31.323440 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-e43b2250-e44b-4b59-8662-35d19465db7a req-c178dbfa-3c9d-43e4-9ee3-3fb46409b5a8 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:31.323874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-e43b2250-e44b-4b59-8662-35d19465db7a req-c178dbfa-3c9d-43e4-9ee3-3fb46409b5a8 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:31.336757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-e43b2250-e44b-4b59-8662-35d19465db7a req-c178dbfa-3c9d-43e4-9ee3-3fb46409b5a8 service nova] Creating event network-vif-deleted:4d0e1155-f5d5-47a0-94e8-82afb1ec3cb8 for instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 on hv-cinder-77398 Aug 27 03:38:31.342477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-e43b2250-e44b-4b59-8662-35d19465db7a req-c178dbfa-3c9d-43e4-9ee3-3fb46409b5a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Aug 27 03:38:31.343084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 540/1043] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:31.948815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:31.949440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:31.955429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:31.956197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:31.957730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:31.958389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:31.974218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] HTTP exception thrown: Instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 could not be found. Aug 27 03:38:31.974857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Returning 404 to user: Instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:38:31.975671 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eaf92fea-972e-4c06-82ea-b8342439bdff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 404 len: 111 microversion: 2.20 time: 0.030703 Aug 27 03:38:31.976689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 504/1044] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:31 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:38:31.985244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-98e2f648-36eb-481f-ae0c-c9e1f2f213ce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '.version_select at 0x7fb1306c7dc0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:32.003569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-98e2f648-36eb-481f-ae0c-c9e1f2f213ce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186912971" status: 204 len: 0 microversion: 2.20 time: 0.022300 Aug 27 03:38:32.004136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 541/1045] 10.222.0.48 () {60 vars in 1259 bytes} [Fri Aug 27 03:38:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186912971 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:38:32.699898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-14830c46-9b36-41da-896d-f1bbeae8d7d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'create', calling method: .version_select at 0x7fb130623700>, body: {"keypair": {"name": "tempest-keypair-889258898"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:32.718556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-14830c46-9b36-41da-896d-f1bbeae8d7d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:32.723141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-14830c46-9b36-41da-896d-f1bbeae8d7d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for user 2e0333e9dafb463c89094944cbba7689 and project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:32.865056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-14830c46-9b36-41da-896d-f1bbeae8d7d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:32.868701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-14830c46-9b36-41da-896d-f1bbeae8d7d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for user 2e0333e9dafb463c89094944cbba7689 and project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:32.882198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-14830c46-9b36-41da-896d-f1bbeae8d7d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.185889 Aug 27 03:38:32.882725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 505/1046] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Aug 27 03:38:32 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:38:34.158642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1473413739", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff1f034d-3826-4da6-8a6a-7416252fe801"}], "security_groups": [{"name": "tempest-securitygroup--782562516"}], "key_name": "tempest-keypair-889258898", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:34.257889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] validate_networks() for [('ff1f034d-3826-4da6-8a6a-7416252fe801', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:38:34.651508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:38:34.651921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:38:34.652387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:38:34.652788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:38:34.653192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:38:34.661753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:34.662234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:34.663020 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:34.663444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:34.678974 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:34.682851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Getting quotas for user 2e0333e9dafb463c89094944cbba7689 and project ce9e1db2319a4a8d89c073898f70aa83. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:34.694255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:38:34.696665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:38:34.744434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-60d63e4b-5fd1-4c91-840d-bd140b243b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.589761 Aug 27 03:38:34.745076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 542/1047] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Aug 27 03:38:34 2021] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:38:34.756526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6ca084fa-95a8-4feb-9fbf-9d89c2188378 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:34.757747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6ca084fa-95a8-4feb-9fbf-9d89c2188378 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:34.817978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ca084fa-95a8-4feb-9fbf-9d89c2188378 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:34.825820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ca084fa-95a8-4feb-9fbf-9d89c2188378 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:34.827387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ca084fa-95a8-4feb-9fbf-9d89c2188378 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:34.828543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6ca084fa-95a8-4feb-9fbf-9d89c2188378 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1281 microversion: 2.20 time: 0.077460 Aug 27 03:38:34.829119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 506/1048] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:34 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:35.847199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:35.848047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:35.854498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:35.854941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:35.855706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:35.856135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:35.953262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:35.960069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:35.961926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:35.963087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-32bf34bf-741b-4db1-a6b8-151d704f9fbd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1341 microversion: 2.20 time: 0.119833 Aug 27 03:38:35.963653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 543/1049] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:35 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1341 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:36.981941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.982781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:36.990403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:36.990856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:36.991665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:36.992237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.215186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:37.225287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:37.226853 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:37.228073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a069ae9d-c63a-4cc6-939b-9a482f4b0338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.249941 Aug 27 03:38:37.228888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 507/1050] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:36 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:37.351763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-74553088-40fe-47f4-8bfa-7ed2cbe56cca req-878225b7-73f4-4011-a540-b9f9b80bc702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:37.353398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:37.353398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:37.362603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-74553088-40fe-47f4-8bfa-7ed2cbe56cca req-878225b7-73f4-4011-a540-b9f9b80bc702 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.363287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-74553088-40fe-47f4-8bfa-7ed2cbe56cca req-878225b7-73f4-4011-a540-b9f9b80bc702 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.376862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-74553088-40fe-47f4-8bfa-7ed2cbe56cca req-878225b7-73f4-4011-a540-b9f9b80bc702 service nova] Creating event network-changed:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:38:37.382901 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-74553088-40fe-47f4-8bfa-7ed2cbe56cca req-878225b7-73f4-4011-a540-b9f9b80bc702 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035193 Aug 27 03:38:37.383460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 544/1051] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:37.578181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:37.579105 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:37.585326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.585766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.586564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.586989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.617941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9072df78-5241-4097-9b5d-2da6b6d0a1fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043566 Aug 27 03:38:37.618722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 508/1052] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:38:37 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:37.680492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:37.681075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:37.687322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.687766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.688799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.689219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.716218 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:38:37.801006 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-51dcae86-e679-4686-88b0-0ce5ea465591 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 204 len: 0 microversion: 2.1 time: 0.123400 Aug 27 03:38:37.801659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 545/1053] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:38:37 2021] DELETE /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:38:37.810371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:37.811005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:37.818559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.819004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:37.819798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:37.820243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:38.094681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:38.104218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-963b6c99-994f-4695-a722-c67f32f25c40 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1675 microversion: 2.1 time: 0.298245 Aug 27 03:38:38.109940 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 509/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:37 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:38.246945 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:38.247651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:38.254239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:38.254779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:38.255561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:38.255989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:38.461738 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:38.469468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:38.470995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:38.472082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-49b57e3e-2e9f-4732-ad0a-d04cc21cc904 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.229310 Aug 27 03:38:38.472646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 546/1055] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:38 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:39.121681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:39.122329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:39.128126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:39.129040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:39.129808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:39.130281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:39.263390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:39.270658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1b43dadc-72fb-4d07-b8f9-8f5176f6dc74 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1675 microversion: 2.1 time: 0.152606 Aug 27 03:38:39.271232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 510/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:39 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:39.489845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:39.490481 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:39.496366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:39.496812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:39.497656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:39.498064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:39.706740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:39.714813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:39.716297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:39.717388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5041ebe2-8e57-4269-8d70-cb5cbee969de tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.231855 Aug 27 03:38:39.717954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 547/1057] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:39 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:40.287569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:40.288378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:40.294488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:40.294934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:40.295702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:40.296136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:40.377365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:40.386317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-332c46a0-af4c-4892-b4a0-b84e871a3682 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 200 len: 1607 microversion: 2.1 time: 0.103089 Aug 27 03:38:40.386914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 511/1058] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:40 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 1607 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:40.412323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-c88c0cd0-def9-48e0-9aa1-89540e12542e req-6ab04046-31c9-448b-99bd-c8969175cfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356e4fdd-62a5-42e5-bb50-a576d9338e22", "name": "network-vif-deleted", "tag": "dc3cad3e-acbe-4108-9aaf-10f03aebdb4f"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:40.414190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:40.414190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:40.422389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c88c0cd0-def9-48e0-9aa1-89540e12542e req-6ab04046-31c9-448b-99bd-c8969175cfad service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:40.422870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c88c0cd0-def9-48e0-9aa1-89540e12542e req-6ab04046-31c9-448b-99bd-c8969175cfad service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:40.437859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-c88c0cd0-def9-48e0-9aa1-89540e12542e req-6ab04046-31c9-448b-99bd-c8969175cfad service nova] Creating event network-vif-deleted:dc3cad3e-acbe-4108-9aaf-10f03aebdb4f for instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 on hv-cinder-77398 Aug 27 03:38:40.445157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-c88c0cd0-def9-48e0-9aa1-89540e12542e req-6ab04046-31c9-448b-99bd-c8969175cfad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Aug 27 03:38:40.445709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 548/1059] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:40.735925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:40.736528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:40.742687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:40.743125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:40.743889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:40.744316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:40.879125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:40.888333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:40.889833 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:40.892782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d6de9e15-16bc-4005-91f1-94e029ca6531 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.160533 Aug 27 03:38:40.893354 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 512/1060] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:40 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:41.404935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:41.405758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:41.412100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:41.412536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:41.413498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:41.413928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:41.428683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] HTTP exception thrown: Instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 could not be found. Aug 27 03:38:41.429271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Returning 404 to user: Instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:38:41.430142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-97e3e639-aee7-4912-bcc5-f3034d0ed07c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 404 len: 111 microversion: 2.1 time: 0.029615 Aug 27 03:38:41.430696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 549/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:41 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:41.439854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2e928488-b162-4be4-a650-44cee1fbce46 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '.version_select at 0x7fb1305e3ca0>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:41.458904 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2e928488-b162-4be4-a650-44cee1fbce46 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398905213" status: 202 len: 0 microversion: 2.1 time: 0.023378 Aug 27 03:38:41.459492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 513/1062] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Aug 27 03:38:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398905213 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:41.913225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:41.914356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:41.921037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:41.921993 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:41.923244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:41.924304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:42.052255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:42.060274 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:42.061754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:42.062887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0cdeb6c6-3fd5-4ae8-b8a8-8d8cc1da52a9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.155068 Aug 27 03:38:42.063710 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 550/1063] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:41 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:42.143296 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-06a82108-6804-416b-a5af-4c274f825d0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'create', calling method: .version_select at 0x7fb1305f08b0>, body: {"keypair": {"name": "tempest-keypair-159797962"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:42.162468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-06a82108-6804-416b-a5af-4c274f825d0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:42.166125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-06a82108-6804-416b-a5af-4c274f825d0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for user 18f04482c6e04433bbfdfc30616162e4 and project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:42.251913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-06a82108-6804-416b-a5af-4c274f825d0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:42.255580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-06a82108-6804-416b-a5af-4c274f825d0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for user 18f04482c6e04433bbfdfc30616162e4 and project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'key_pairs'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:42.268131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-06a82108-6804-416b-a5af-4c274f825d0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.128682 Aug 27 03:38:42.268803 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 514/1064] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Aug 27 03:38:42 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:43.080619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:43.081378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:43.087758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:43.088208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:43.088982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:43.089450 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:43.288190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:43.295915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:43.297430 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:43.298566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-66bb651c-fa79-4de8-a9b3-f3a4a4f16b13 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.221751 Aug 27 03:38:43.299281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 551/1065] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:43 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:43.632598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-406344853", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c726867b-13f8-4cdb-bf0d-2cd6fe0b7fc4"}], "security_groups": [{"name": "tempest-securitygroup--49112139"}], "key_name": "tempest-keypair-159797962", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:43.726094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] validate_networks() for [('c726867b-13f8-4cdb-bf0d-2cd6fe0b7fc4', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:38:44.017368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-87719995-0e17-4841-8f2b-50e8285719f4 req-a19fa26f-642b-4bf5-a8b8-39a39e8e0a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "name": "network-vif-plugged", "status": "completed", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:44.019183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:44.019183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:44.026423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-87719995-0e17-4841-8f2b-50e8285719f4 req-a19fa26f-642b-4bf5-a8b8-39a39e8e0a07 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:44.026860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-87719995-0e17-4841-8f2b-50e8285719f4 req-a19fa26f-642b-4bf5-a8b8-39a39e8e0a07 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:44.038193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-87719995-0e17-4841-8f2b-50e8285719f4 req-a19fa26f-642b-4bf5-a8b8-39a39e8e0a07 service nova] Creating event network-vif-plugged:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:38:44.043124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-87719995-0e17-4841-8f2b-50e8285719f4 req-a19fa26f-642b-4bf5-a8b8-39a39e8e0a07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029745 Aug 27 03:38:44.043712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 552/1066] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:44.160398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:38:44.160889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:38:44.161429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:38:44.161905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:38:44.162450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:38:44.173605 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:44.174100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:44.175573 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:44.176056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:44.193388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:44.197480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Getting quotas for user 18f04482c6e04433bbfdfc30616162e4 and project 57d7d769521e4286baaa5fc29a8f22ff. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:44.208394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:38:44.210877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:38:44.257835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-801088de-a5fb-40cc-86f3-6480ea3baa34 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.630066 Aug 27 03:38:44.258845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 515/1067] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 03:38:43 2021] POST /compute/v2.1/servers => generated 400 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:38:44.268868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fb357afc-9556-4527-ab25-f92641edf691 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:44.269794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fb357afc-9556-4527-ab25-f92641edf691 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:44.316815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:44.317508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:44.323328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:44.323766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:44.324519 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:44.324943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:44.332228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fb357afc-9556-4527-ab25-f92641edf691 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:44.339665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fb357afc-9556-4527-ab25-f92641edf691 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1236 microversion: 2.1 time: 0.074877 Aug 27 03:38:44.340730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 553/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:44.456368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:44.464316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:44.465805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:44.466907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2431aeab-37c2-4a7b-943d-a9bedbf8f5d0 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.154263 Aug 27 03:38:44.467460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 516/1069] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:44 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:38:45.357723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.358369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:45.364905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:45.365362 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:45.366157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:45.366603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:45.434272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:45.442886 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-950cf259-a15f-4017-8d32-07a3ee98bd28 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1288 microversion: 2.1 time: 0.088768 Aug 27 03:38:45.443461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 554/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:45.484983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.485568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:45.494033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:45.494484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:45.495262 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:45.495697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:45.706686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:45.715512 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:45.717496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:45.718695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8818caee-4040-4a21-9db6-99eda2fd221a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1406 microversion: 2.20 time: 0.237826 Aug 27 03:38:45.719406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 517/1071] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:45 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:46.462625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.463238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:46.469418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:46.469853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:46.470835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:46.471264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:46.669737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.678037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-eaff579d-73ff-4182-9673-3f94c1e27190 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.219129 Aug 27 03:38:46.678621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 555/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:46.736741 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.737462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:46.743438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:46.743810 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:46.744579 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:46.745071 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:46.957490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.965478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.967106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.968368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-62b7290c-3ab6-42b2-a6e2-a6b802c41021 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1598 microversion: 2.20 time: 0.235700 Aug 27 03:38:46.968928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 518/1073] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:38:46 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:38:46.986134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.986629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:46.992593 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:46.993034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:46.993853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:46.994256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:47.102732 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-e0d2df85-2daa-4a27-8ea2-031ae266f1c8 req-de02303a-4d20-428d-af35-c3d0c6f81bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ffde52-808b-45c5-8e77-3a763ad6db4c", "tag": "d24d4ce4-d453-4fce-9851-c391c52874bb"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:47.104827 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:47.104827 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:38:47.113754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-e0d2df85-2daa-4a27-8ea2-031ae266f1c8 req-de02303a-4d20-428d-af35-c3d0c6f81bcc service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:47.114264 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-e0d2df85-2daa-4a27-8ea2-031ae266f1c8 req-de02303a-4d20-428d-af35-c3d0c6f81bcc service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:47.126387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-e0d2df85-2daa-4a27-8ea2-031ae266f1c8 req-de02303a-4d20-428d-af35-c3d0c6f81bcc service nova] Creating event network-changed:d24d4ce4-d453-4fce-9851-c391c52874bb for instance e1ffde52-808b-45c5-8e77-3a763ad6db4c on hv-cinder-77398 Aug 27 03:38:47.129640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-525abafd-f562-4468-b557-842b8ce058bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.147296 Aug 27 03:38:47.133922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-e0d2df85-2daa-4a27-8ea2-031ae266f1c8 req-de02303a-4d20-428d-af35-c3d0c6f81bcc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034586 Aug 27 03:38:47.135118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 519/1074] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:47.142460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 556/1075] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Aug 27 03:38:46 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:38:47.696651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:47.697534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:47.704511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:47.705080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:47.705953 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:47.706659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:47.917427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:47.925538 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e665ea42-dc0d-43c9-bbd7-f3107d4f8c9d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.232724 Aug 27 03:38:47.926292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 520/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:48.341231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:48.342268 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:48.344103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-35f63c09-47c6-4985-bf23-b36c4f2a9586 req-64a13a44-18e6-4d79-940e-d257a703b8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:48.345804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:48.345804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:38:48.355004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-35f63c09-47c6-4985-bf23-b36c4f2a9586 req-64a13a44-18e6-4d79-940e-d257a703b8fc service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:48.355706 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-35f63c09-47c6-4985-bf23-b36c4f2a9586 req-64a13a44-18e6-4d79-940e-d257a703b8fc service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:48.355987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:48.356499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:48.357334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:48.357832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:48.370214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-35f63c09-47c6-4985-bf23-b36c4f2a9586 req-64a13a44-18e6-4d79-940e-d257a703b8fc service nova] Creating event network-changed:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:38:48.376710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-35f63c09-47c6-4985-bf23-b36c4f2a9586 req-64a13a44-18e6-4d79-940e-d257a703b8fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035764 Aug 27 03:38:48.377872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 521/1077] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:48.493085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-244ec7f2-d79f-480a-aeba-b2672ed48bb9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.155335 Aug 27 03:38:48.496654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 557/1078] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:48 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:48.943718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:48.944748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:48.950934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:48.951388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:48.952168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:48.952622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:49.154659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:49.163339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f635becf-22ad-4ed7-8319-3bac59de6743 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.224020 Aug 27 03:38:49.172480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 522/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:49.504598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:49.505595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:49.512194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:49.512636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:49.513404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:49.513830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:49.612088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ab20f0b0-25a5-4c01-945e-9ddc7c6af85a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.112123 Aug 27 03:38:49.613366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 558/1080] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:49 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:50.180601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:50.181241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:50.187162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:50.187613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:50.188645 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:50.189082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:50.312244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:50.321019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f15870a2-b0ec-4667-9e1e-7f8eb79f6d89 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.144040 Aug 27 03:38:50.321605 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 523/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:50.623186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:50.624180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:50.632189 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:50.632624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:50.633390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:50.633811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:50.721329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5c963d10-2197-4e4f-b379-864501d832a3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.101998 Aug 27 03:38:50.722288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 559/1082] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:50 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:51.337558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:51.338218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:51.344123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:51.344565 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:51.345324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:51.345759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:51.464813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:51.472584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-77ae7ad5-dafe-439c-82d9-c8282152408c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.138027 Aug 27 03:38:51.473142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 524/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:51.733013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:51.734062 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:51.740715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:51.741151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:51.741898 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:51.742360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:51.823787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1a8fb2dd-d2c0-4e07-8e0f-1af5d18daced tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.094640 Aug 27 03:38:51.826915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 560/1084] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:51 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:52.486231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:38:52.490120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:52.490735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:52.496607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:52.497076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:52.497834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:52.498310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:52.622795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:52.630546 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1f488dfc-0c50-459c-8963-c19cb31bef8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.145719 Aug 27 03:38:52.631047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 525/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:52.835809 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:52.836809 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:52.843215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:52.843662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:52.844421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:52.844854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:52.955725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6f21892f-c192-4cce-80a9-3f773b9ff3ee tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.124345 Aug 27 03:38:52.957568 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 561/1086] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:52 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:53.647541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:53.648137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:53.665062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:53.665501 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:53.666292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:53.666718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:53.671638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45000. Aug 27 03:38:53.797080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:53.805770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-10ec4e31-eb05-4fcc-b016-507c1fbbef5f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.162273 Aug 27 03:38:53.806398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 526/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:53 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:53.965251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-de757250-6f73-4e42-86ee-29e65a1ee5d6 req-da58059f-eed4-43ee-87eb-c98e10b4f751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ffde52-808b-45c5-8e77-3a763ad6db4c", "name": "network-vif-plugged", "status": "completed", "tag": "d24d4ce4-d453-4fce-9851-c391c52874bb"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:53.966900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:53.966900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:53.971387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:53.973044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:53.976015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-de757250-6f73-4e42-86ee-29e65a1ee5d6 req-da58059f-eed4-43ee-87eb-c98e10b4f751 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:53.976455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-de757250-6f73-4e42-86ee-29e65a1ee5d6 req-da58059f-eed4-43ee-87eb-c98e10b4f751 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:53.979388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:53.979871 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:53.981178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:53.981178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:53.988638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-de757250-6f73-4e42-86ee-29e65a1ee5d6 req-da58059f-eed4-43ee-87eb-c98e10b4f751 service nova] Creating event network-vif-plugged:d24d4ce4-d453-4fce-9851-c391c52874bb for instance e1ffde52-808b-45c5-8e77-3a763ad6db4c on hv-cinder-77398 Aug 27 03:38:53.993445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-de757250-6f73-4e42-86ee-29e65a1ee5d6 req-da58059f-eed4-43ee-87eb-c98e10b4f751 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Aug 27 03:38:53.994543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 562/1088] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:54.110120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7691e0e4-10a3-4d66-a708-679bbccc3360 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.142153 Aug 27 03:38:54.111039 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 527/1089] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:53 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:54.823582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:54.824281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:54.831708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:54.832193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:54.832975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:54.833403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:54.961148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:54.968184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5f22d8bc-fe67-439b-af77-6e5c9992e9bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1360 microversion: 2.1 time: 0.148805 Aug 27 03:38:54.968741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 563/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:55.122035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:55.122939 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:55.129941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:55.130398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:55.131149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:55.131583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:55.247317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aed72a53-3169-486c-b2fd-06a026412bd9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.129267 Aug 27 03:38:55.247941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 528/1091] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:55 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:55.987666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:55.988431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:55.995711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:55.996154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:55.997034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:55.997541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:56.120002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:56.127436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-552b6d36-a5ce-4829-842e-5cf35b4995d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1546 microversion: 2.1 time: 0.144104 Aug 27 03:38:56.128166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 564/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:38:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1546 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:56.145376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:56.150343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:56.152679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:56.153120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:56.153888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:56.154344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:56.236411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3b8a53e2-cfee-4ea0-95c2-d88d5275f5b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096120 Aug 27 03:38:56.236994 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 529/1093] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Aug 27 03:38:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:56.258709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:56.259637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:56.265478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:56.265922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:56.266720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:56.267153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:56.358988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-446fd92a-33fc-4e1a-974c-9ae952c25338 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.103940 Aug 27 03:38:56.360548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 565/1094] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:56 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:57.217358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:57.218058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-7a37966b-edc9-4f8d-98d4-819852ce7dc3 req-5af8ab24-f39f-4737-8924-c29207bdc029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ffde52-808b-45c5-8e77-3a763ad6db4c", "tag": "d24d4ce4-d453-4fce-9851-c391c52874bb"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:57.218474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:57.219547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:38:57.219547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:38:57.226637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:57.227091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:57.227880 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:57.228685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:57.229585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-7a37966b-edc9-4f8d-98d4-819852ce7dc3 req-5af8ab24-f39f-4737-8924-c29207bdc029 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:57.229938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-7a37966b-edc9-4f8d-98d4-819852ce7dc3 req-5af8ab24-f39f-4737-8924-c29207bdc029 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:57.242320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-7a37966b-edc9-4f8d-98d4-819852ce7dc3 req-5af8ab24-f39f-4737-8924-c29207bdc029 service nova] Creating event network-changed:d24d4ce4-d453-4fce-9851-c391c52874bb for instance e1ffde52-808b-45c5-8e77-3a763ad6db4c on hv-cinder-77398 Aug 27 03:38:57.247986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-7a37966b-edc9-4f8d-98d4-819852ce7dc3 req-5af8ab24-f39f-4737-8924-c29207bdc029 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034012 Aug 27 03:38:57.247986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 566/1095] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:38:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:57.360399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-644d4926-a68c-404c-9a0c-244290db30eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.149200 Aug 27 03:38:57.364227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 530/1096] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:38:57 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:57.370925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:57.372008 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:57.380063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:57.380516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:57.381297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:57.381732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:57.476325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-51af85d5-9a8e-4fde-9a94-dd3350a72cd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.109620 Aug 27 03:38:57.478064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 567/1097] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:57 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:58.372633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:58.373583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:58.381424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:58.381872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:58.382700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:58.383580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:58.468814 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0f45fe49-7f96-4600-9e48-61db13892923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.100235 Aug 27 03:38:58.469970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 531/1098] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:38:58 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:58.490471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:58.491813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:58.498352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:58.498796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:58.499557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:58.499986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:58.584239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9badfd96-9289-4a39-9784-826341e014c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 14 microversion: 2.20 time: 0.098946 Aug 27 03:38:58.585042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 568/1099] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:58 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:59.480605 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:59.481607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:59.488785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:59.489226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:59.489990 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:59.490459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:59.586405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8fb4b675-003a-4071-b4cb-b6b9b5d10d6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.109688 Aug 27 03:38:59.587043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 532/1100] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:38:59 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:59.594969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:59.595964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:38:59.603311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:59.603692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:59.604457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:59.604885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:59.712890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ad6f5cc3-929c-4e61-ab99-6f158ffe3cdf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 8434 microversion: 2.20 time: 0.121851 Aug 27 03:38:59.713584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 569/1101] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:38:59 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 8434 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:39:00.597979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:00.599039 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:00.605460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:00.605910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:00.606715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:00.607150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:00.687807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d3b2b572-bd4f-4664-aa21-483bfbac3831 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.094259 Aug 27 03:39:00.688655 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 533/1102] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:00 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:00.725151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:00.726202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:00.734217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:00.735800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:00.736629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:00.737064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:00.836391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d4b1cb06-fae2-418c-a333-63b532ee1544 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 16081 microversion: 2.20 time: 0.115735 Aug 27 03:39:00.837067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 570/1103] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:00 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 16081 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:01.700131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:01.701117 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:01.707563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:01.708047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:01.708842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:01.709273 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:01.815801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aa0aef42-8fb6-45ef-92e4-c558af07fbdf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.119426 Aug 27 03:39:01.816394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 534/1104] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:01 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:01.848329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:01.850266 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:01.856813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:01.857255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:01.858038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:01.858504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:01.958133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-feefbcd0-83f4-4421-904f-4eaaee7309f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 18356 microversion: 2.20 time: 0.113725 Aug 27 03:39:01.958897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 571/1105] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:01 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 18356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:02.828441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:02.829347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:02.836133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:02.836581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:02.837355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:02.837790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:02.921887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d7875495-a25a-4b33-aaa9-088ec4ac7a2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.097336 Aug 27 03:39:02.922780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 535/1106] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:02 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:02.970155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:02.971144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:02.978332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:02.978775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:02.979543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:02.979966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:03.071121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7be9faef-2b20-46c4-8e16-8c73a22ae32d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 20675 microversion: 2.20 time: 0.104886 Aug 27 03:39:03.071777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 572/1107] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:02 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 20675 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:03.933107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:03.934130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:03.940826 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:03.941261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:03.942035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:03.942461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:04.026654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fe124005-7b14-449f-9dab-9cf0d7eab6d0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.097292 Aug 27 03:39:04.027203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 536/1108] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:03 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:04.084196 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:04.085209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:04.091654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:04.092095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:04.092862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:04.093297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:04.214428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-31a76146-d099-41e3-bed8-4c774f3a79cc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 22897 microversion: 2.20 time: 0.135048 Aug 27 03:39:04.215370 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 573/1109] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:04 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 22897 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:05.039256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:05.040628 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:05.048753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:05.049200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:05.049976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:05.050435 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:05.160008 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8035a9a2-5ac9-4c08-84ed-1239a679a332 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.125997 Aug 27 03:39:05.160649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 537/1110] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:05 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:05.227247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:05.228380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:05.234861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:05.235312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:05.236081 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:05.236516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:05.357026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-706a243d-e742-462a-b7d6-05ca84c3391b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 23990 microversion: 2.20 time: 0.134376 Aug 27 03:39:05.357821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 574/1111] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:05 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 23990 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:06.171371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:06.172466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:06.179650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:06.180105 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:06.180863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:06.181321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:06.264232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-48b81e1e-1bbe-4687-a119-1417cedc90a7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.096783 Aug 27 03:39:06.264862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 538/1112] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:06 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:06.369847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:06.370867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:06.377267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:06.377708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:06.378513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:06.378950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:06.485732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-970d42c9-8f1f-4f42-9f41-3735156fce41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 25576 microversion: 2.20 time: 0.119771 Aug 27 03:39:06.486420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 575/1113] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:06 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 25576 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:07.275806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:07.276903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:07.283374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:07.283862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:07.284695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:07.285169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:07.383302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bc181d8a-1480-4c83-8d1f-d82e7ee9d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.111443 Aug 27 03:39:07.383941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 539/1114] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:07 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:07.499208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:07.500208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:07.506772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:07.507296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:07.508045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:07.508475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:07.615066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f185c73a-0321-48b2-8055-b908fde82b1a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 26871 microversion: 2.20 time: 0.119839 Aug 27 03:39:07.615715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 576/1115] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:07 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 26871 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:08.394786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:08.396656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:08.403131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:08.403570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:08.404324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:08.404748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:08.496280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9d6c7c0b-76a3-43b5-ac5d-a62e25088bf0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 14 microversion: 2.1 time: 0.105324 Aug 27 03:39:08.496906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 540/1116] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:08 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:39:08.627169 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:08.628175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:08.635283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:08.635730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:08.636493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:08.636928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:08.743525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-36b92261-f5f4-4496-a45c-a5bbdd36776a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 27644 microversion: 2.20 time: 0.120273 Aug 27 03:39:08.744438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 577/1117] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:08 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 27644 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:09.508140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:09.509180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:09.515631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:09.516076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:09.516845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:09.517277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:09.639599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-55895a54-647f-4382-afee-9a16c6829cbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 9228 microversion: 2.1 time: 0.135805 Aug 27 03:39:09.640252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 541/1118] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:09 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 9228 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:09.756941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:09.757950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:09.764642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:09.765009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:09.765786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:09.766253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:09.883069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-270fb3ba-57b2-4d1a-9496-3a1d5fff6e1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 27943 microversion: 2.20 time: 0.131323 Aug 27 03:39:09.884503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 578/1119] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:09 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 27943 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:10.652224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:10.653223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:10.659834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:10.660311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:10.661821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:10.662286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:10.760336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-889d9c0f-3500-464f-9c0c-a57c295b3a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 16280 microversion: 2.1 time: 0.111991 Aug 27 03:39:10.761023 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 542/1120] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:10 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 16280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:10.896037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:10.897600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:10.904592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:10.905036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:10.905804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:10.906262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:11.026456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c1489067-165b-4ef1-9fa4-b62aebed6392 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.134392 Aug 27 03:39:11.027351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 579/1121] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:10 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:11.772314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:11.773302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:11.780061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:11.780523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:11.781283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:11.781710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:11.893707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2c53fa82-1310-42df-8413-c841428d4e37 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 18356 microversion: 2.1 time: 0.125351 Aug 27 03:39:11.894513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 543/1122] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:11 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 18356 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:12.038348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:12.039604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:12.046246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:12.046692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:12.047496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:12.047928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:12.182294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7aebe561-cf91-4ccd-8a97-3e258ec2c89c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.148508 Aug 27 03:39:12.183463 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 580/1123] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:12 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:12.905364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:12.906304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:12.913447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:12.913894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:12.914693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:12.915128 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:13.008375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-71784336-1b61-4411-ad06-763bd8ced009 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 19342 microversion: 2.1 time: 0.106984 Aug 27 03:39:13.009220 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 544/1124] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:12 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 19342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:13.195701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:13.196642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:13.204934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:13.205374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:13.206156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:13.206586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:13.294890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d0555d60-4c16-44c4-a9d1-ba073447b23e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.103888 Aug 27 03:39:13.295545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 581/1125] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:13 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:14.019713 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:14.021507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:14.027915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:14.028350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:14.029101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:14.029527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:14.139577 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b7386170-fee2-48ec-8c71-0806022e499d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 22217 microversion: 2.1 time: 0.123643 Aug 27 03:39:14.140232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 545/1126] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:14 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 22217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:14.307260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:14.308206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:14.315009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:14.315445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:14.316199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:14.316625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:14.417887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-19cbaa60-d0e0-495e-a10e-7938951d12bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.114558 Aug 27 03:39:14.418584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 582/1127] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:14 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:15.151681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:15.152691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:15.159641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:15.160087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:15.161482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:15.161924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:15.255551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-926eee55-8e46-4db7-9c95-142902654823 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 23804 microversion: 2.1 time: 0.108009 Aug 27 03:39:15.256179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 546/1128] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:15 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 23804 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:15.429376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:15.430309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:15.436674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:15.437107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:15.437856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:15.438572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:15.529609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e5240762-7668-4852-b2e2-80b307d3d37b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.104297 Aug 27 03:39:15.530269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 583/1129] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:15 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:16.266718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:16.267743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:16.274835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:16.275277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:16.276067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:16.276500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:16.375313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fdcabd1e-6030-4c4c-ba16-b5e9d19c6036 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 25257 microversion: 2.1 time: 0.112460 Aug 27 03:39:16.375964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 547/1130] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:16 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 25257 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:16.541916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:16.542887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:16.549408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:16.549878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:16.550647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:16.551079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:16.670404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-12d7710d-0ab8-4bb8-b34a-bf660cfa0dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.132408 Aug 27 03:39:16.671082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 584/1131] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:16 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:17.386930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:17.387930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:17.394548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:17.394995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:17.396788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:17.397223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:17.504366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b565743e-bef0-4540-8d36-96e3ff5bc176 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 26703 microversion: 2.1 time: 0.121274 Aug 27 03:39:17.505033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 548/1132] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:17 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 26703 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:17.682381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:17.683497 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:17.690161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:17.690610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:17.691380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:17.691814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:17.790475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a46916be-c393-4ed4-9dd9-f1f3d5227692 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.111955 Aug 27 03:39:17.791377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 585/1133] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:17 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:18.516705 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:18.517679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:18.524194 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:18.524625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:18.525380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:18.525811 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:18.636639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-14074226-e363-4e85-b7f5-f2713a211795 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 27619 microversion: 2.1 time: 0.123793 Aug 27 03:39:18.637533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 549/1134] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:18 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 27619 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:18.803612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:18.804539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:18.811077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:18.811516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:18.812280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:18.812708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:18.907699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8fc088c7-6bb4-4a6a-a8ca-fc6dbc8de2ec tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.108757 Aug 27 03:39:18.908355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 586/1135] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:18 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:19.648662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:19.649649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:19.656149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:19.656592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:19.657348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:19.657777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:19.756568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5ea6f4fb-b25a-4145-b54c-26c5ef981454 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 27847 microversion: 2.1 time: 0.111771 Aug 27 03:39:19.757211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 550/1136] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:19 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 27847 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:19.919748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:19.920699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:19.927929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:19.928369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:19.929132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:19.929561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:20.021095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5641c50b-20e4-46ef-971d-f69e500de03b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.104623 Aug 27 03:39:20.022045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 587/1137] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:19 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:20.768022 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:20.769024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:20.776092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:20.776540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:20.777303 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:20.777737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:20.890863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-51df03ce-7ba1-4105-a268-ae6a25e9ae6f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.125619 Aug 27 03:39:20.890863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 551/1138] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:20 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:21.032444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:21.033444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:21.040848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:21.041286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:21.042059 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:21.042488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:21.132034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e54be698-4c96-4ceb-9bb6-7ebe649bbeaf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.103240 Aug 27 03:39:21.133141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 588/1139] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:21 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:21.901557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:21.902600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:21.909065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:21.909508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:21.910299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:21.910736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:21.997348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-94ecb956-c5db-462e-a4d0-a3711c614b16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.099640 Aug 27 03:39:21.998272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 552/1140] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:21 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:22.144844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:22.146604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:22.152976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:22.153413 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:22.154196 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:22.154620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:22.242222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4e34097b-b46c-489f-9d39-b24e35ee1344 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.101284 Aug 27 03:39:22.242878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 589/1141] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:22 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:23.010324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:23.011412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:23.018049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:23.018504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:23.019390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:23.019832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:23.109667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d1f5ab18-e5d1-4254-8e21-dc133995dfbf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.103360 Aug 27 03:39:23.110345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 553/1142] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:23 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:23.255335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:23.256870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:23.263502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:23.263879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:23.264640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:23.265062 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:23.351676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d36c24a6-2c68-4ab8-b1b5-ee79af0a5bfd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.101028 Aug 27 03:39:23.352589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 590/1143] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:23 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:24.122450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:24.123474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:24.130712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:24.131147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:24.131902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:24.132328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:24.224598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4f6a21da-f2cb-4dcc-b445-ee5bc870cf0d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.106224 Aug 27 03:39:24.225728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 554/1144] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:24 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:24.363708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:24.364988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:24.374794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:24.375161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:24.375936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:24.376369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:24.463708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fb3b75cb-5814-4f96-bfae-5a8854828d34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28192 microversion: 2.20 time: 0.103945 Aug 27 03:39:24.464365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 591/1145] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:24 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:25.237135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:25.238169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:25.244933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:25.245380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:25.246183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:25.246619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:25.331351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ce4d3a19-f555-4758-820e-584b1d855f0b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.098157 Aug 27 03:39:25.332272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 555/1146] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:25 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:25.476257 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:25.477180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:25.483755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:25.484191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:25.484960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:25.485381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:25.591176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-822da9d5-9bd7-467a-8988-4d560625b0da tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28483 microversion: 2.20 time: 0.119346 Aug 27 03:39:25.591834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 592/1147] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:25 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28483 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:26.345500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:26.346521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:26.353251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:26.353679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:26.354504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:26.354939 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:26.439427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8bfb425e-0a03-45ef-b81a-08fa9016b353 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.097823 Aug 27 03:39:26.440088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 556/1148] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:26 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:26.603904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:26.604906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:26.611655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:26.612097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:26.612867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:26.613296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:26.708184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6129763d-6822-4d2b-87b3-813f80fa1d58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28649 microversion: 2.20 time: 0.108072 Aug 27 03:39:26.708831 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 593/1149] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:26 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28649 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:27.452191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:27.453193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:27.460630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:27.461079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:27.461842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:27.462307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:27.548482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eef1d895-4814-4453-9a9f-10e470e7ba38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.100090 Aug 27 03:39:27.549136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 557/1150] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:27 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:39:27.720172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:27.721063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:27.727621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:27.728055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:27.728807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:27.729226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:27.829832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-59f7d87c-b1a4-4c0e-8da1-07a6182fa289 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.113592 Aug 27 03:39:27.830525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 594/1151] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:27 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:28.561360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:28.562388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:28.569318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:28.569793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:28.570596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:28.571023 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:28.662959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-43482d21-c5c6-4f48-84e8-dc875aa0ef21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.105424 Aug 27 03:39:28.663895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 558/1152] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:28 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:28.841333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:28.842280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:28.849359 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:28.849796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:28.850583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:28.851015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:28.942953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-518a6bbe-98e7-4749-992c-24cc05f6a3c9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.105012 Aug 27 03:39:28.943759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 595/1153] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:28 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:29.674987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:29.675992 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:29.683170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:29.683614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:29.684374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:29.684800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:29.769015 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-104d39a9-c3ba-44c7-a2e4-e1e5a3f0bab8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.097820 Aug 27 03:39:29.769660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 559/1154] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:29 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:29.955258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:29.956184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:29.963876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:29.964488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:29.965387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:29.965942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:30.053994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6439e7cd-b12f-405c-ba8d-f8b5d3cd32c7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.102822 Aug 27 03:39:30.054678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 596/1155] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:29 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:30.780744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:30.781742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:30.788297 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:30.788755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:30.789520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:30.789954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:30.874542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d5ffb96b-5891-4902-8c7b-b829a8bd7ad5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.097516 Aug 27 03:39:30.875115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 560/1156] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:30 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:31.066586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:31.068854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:31.075422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:31.075866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:31.076635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:31.077067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:31.170577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a5b2c7b6-3bf8-46b5-b11e-7e3fad99628a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.108161 Aug 27 03:39:31.171176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 597/1157] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:31 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:31.887304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:31.888205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:31.894633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:31.895744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:31.896646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:31.897083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:31.981060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a13c1f98-83d8-4bb0-8b3b-0bb282766ebd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.097703 Aug 27 03:39:31.981717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 561/1158] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:31 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:32.183045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:32.183983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:32.190718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:32.191164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:32.192951 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:32.193403 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:32.275779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f933896a-6aee-46f0-8a88-737d33b1b714 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.096758 Aug 27 03:39:32.276669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 598/1159] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:32 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:32.993730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:32.994752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:33.001167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:33.001610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:33.002409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:33.002841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:33.091057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8193bbbd-ef88-4305-ae5d-fc43205d7668 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.101229 Aug 27 03:39:33.091690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 562/1160] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:32 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:33.288867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:33.289791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:33.296172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:33.296610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:33.297368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:33.297796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:33.391826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9858c2fb-813c-4b58-baa8-6b9ddf575c19 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.107632 Aug 27 03:39:33.392708 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 599/1161] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:33 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:34.103167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:34.104199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:34.110694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:34.111137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:34.111895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:34.112326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:34.197691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-10eb3345-ad1d-4e30-85e4-2c81b65e7a7e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.099080 Aug 27 03:39:34.198650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 563/1162] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:34 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:34.404896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:34.405799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:34.412436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:34.412880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:34.413637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:34.414104 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:34.502673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-67c39f4d-05c0-4405-b98b-be2be1726717 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.101716 Aug 27 03:39:34.503555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 600/1163] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:34 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:35.211850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:35.213052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:35.220476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:35.220892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:35.221670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:35.222131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:35.306729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aed3f27c-8631-4d58-ae8f-2c454e902140 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.100671 Aug 27 03:39:35.307386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 564/1164] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:35 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:35.515400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:35.516397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:35.523560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:35.523996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:35.524753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:35.525182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:35.612540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c940818d-6ce6-4881-8d94-fafec1a72635 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.101006 Aug 27 03:39:35.613204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 601/1165] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:35 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:36.319265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:36.320312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:36.326896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:36.327342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:36.328108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:36.328537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:36.417879 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3b9b196c-f981-4aaf-9948-798045d61f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28165 microversion: 2.1 time: 0.102501 Aug 27 03:39:36.418830 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 565/1166] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:36 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28165 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:36.624806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:36.625720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:36.632623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:36.633061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:36.633814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:36.634272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:36.717852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d46a593d-7421-46ba-8c94-f72c872f0034 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.097058 Aug 27 03:39:36.718545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 602/1167] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:36 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:37.430197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:37.431189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:37.437882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:37.438707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:37.439482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:37.439907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:37.586138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ff0f19b3-ae71-4ab1-a88e-5f8d0264c8d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28292 microversion: 2.1 time: 0.160465 Aug 27 03:39:37.587041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 566/1168] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:37 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28292 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:37.730204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:37.731204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:37.737658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:37.738129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:37.738965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:37.739443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:37.829685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d4a09f64-6abb-4c17-aebd-e8f31696948a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.103650 Aug 27 03:39:37.830356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 603/1169] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:37 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:38.597261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:38.600374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:38.606920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:38.607364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:38.608140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:38.608572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:38.708839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2e9e998f-bb03-44ee-9ffb-dc1cd74c35d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28456 microversion: 2.1 time: 0.114088 Aug 27 03:39:38.709510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 567/1170] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:38 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28456 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:39:38.842717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:38.843636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:38.850410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:38.850854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:38.851634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:38.852060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:38.947125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cf03f70e-3673-4f8e-b3bf-4e3b057d2c5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.108470 Aug 27 03:39:38.948070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 604/1171] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:38 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:39.721017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:39.722028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:39.728784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:39.729232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:39.730094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:39.730531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:39.832495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a8a54e1e-f615-4d4c-88c7-a80131b6bb51 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.115288 Aug 27 03:39:39.833057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 568/1172] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:39 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:39.959400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:39.960393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:39.966900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:39.967338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:39.968090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:39.968517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:40.054404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-31540c3a-4bc6-4ac0-afe8-8eeba15461e7 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.098903 Aug 27 03:39:40.055336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 605/1173] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:39 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:40.844846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:40.845773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:40.852941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:40.853384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:40.854180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:40.854616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:40.945534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4fc9be0a-6b1e-4a0f-88e4-b8990ed27eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.104657 Aug 27 03:39:40.946212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 569/1174] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:40 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:41.066550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:41.068037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:41.074395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:41.074833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:41.075576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:41.076000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:41.164733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-43c8bda4-0a72-4b9c-8a72-361f076dec1e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.102362 Aug 27 03:39:41.165287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 606/1175] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:41 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:41.958191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:41.959149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:41.965509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:41.965944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:41.966714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:41.967138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:42.066279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0a9462f3-63d1-44d2-8b4a-12c17e74ae72 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.112509 Aug 27 03:39:42.066908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 570/1176] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:41 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:42.177162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:42.178222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:42.185032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:42.185472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:42.186264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:42.186693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:42.277910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ad55d1a7-7275-4274-a365-958d7674ef41 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.105183 Aug 27 03:39:42.278910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 607/1177] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:42 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:43.078506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:43.079531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:43.087164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:43.087610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:43.088371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:43.088804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:43.191347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-98b36d09-4c1a-443e-94d5-18c1c2eb2097 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.116751 Aug 27 03:39:43.193043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 571/1178] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:43 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:43.290681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:43.291696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:43.300349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:43.300795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:43.301953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:43.302414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:43.394641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0c0b8d33-e8c7-4edb-9b6f-982f66117348 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.107993 Aug 27 03:39:43.395889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 608/1179] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:43 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:44.205844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:44.206892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:44.214024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:44.214493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:44.215254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:44.215689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:44.311995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0cd975df-ac04-46ec-9679-ad13886cff57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.110049 Aug 27 03:39:44.312897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 572/1180] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:44 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:44.407188 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:44.408249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:44.414812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:44.415246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:44.415996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:44.416419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:44.523012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-085f69be-fe54-4e2f-97c7-f88cbde40855 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.119634 Aug 27 03:39:44.523666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 609/1181] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:44 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:45.323856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:45.324857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:45.331534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:45.331975 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:45.333518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:45.333945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:45.425311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0199ba85-f26f-43bb-bff7-939a9e2462d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.105277 Aug 27 03:39:45.425957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 573/1182] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:45 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:45.535185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:45.536753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:45.543636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:45.544076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:45.544856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:45.545284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:45.650541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2d3666f1-0fda-4e32-a1c1-ad9a669ac42c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.119117 Aug 27 03:39:45.651416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 610/1183] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:45 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:46.437549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:46.438858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:46.446030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:46.446483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:46.447257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:46.447694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:46.538417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-75c06622-5bbb-41a2-8f88-48d24ddb1fdb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.104760 Aug 27 03:39:46.539083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 574/1184] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:46 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:46.663107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:46.664101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:46.671823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:46.672259 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:46.673019 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:46.673464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:46.760526 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0b73b087-d61c-4982-ab91-b19e333769bc tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.101457 Aug 27 03:39:46.761188 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 611/1185] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:46 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:47.550684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:47.552786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:47.560072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:47.560522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:47.561305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:47.561746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:47.652593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1a1265a0-03a5-4b02-832c-e3a6f6723a69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.105830 Aug 27 03:39:47.653266 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 575/1186] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:47 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:47.773485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:47.774521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:47.781644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:47.782274 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:47.783152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:47.783683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:47.882644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bc0aaeb0-9513-418e-a026-c7b21cab0067 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.113625 Aug 27 03:39:47.883513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 612/1187] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:47 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:48.664313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:48.665451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:48.672118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:48.672557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:48.673321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:48.673750 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:48.778228 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f2177ae7-4b54-427d-8af5-b8dab0e0ba26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.117705 Aug 27 03:39:48.778886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 576/1188] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:48 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:48.894843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:48.895763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:48.902530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:48.903025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:48.903818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:48.904264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:48.992125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2d816fcf-09cc-498e-be89-fd22f3c8f5f5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.101311 Aug 27 03:39:48.992861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 613/1189] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:48 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:49.790527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:49.791527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:49.797861 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:49.798320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:49.799071 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:49.799497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:49.894048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-27f65e05-a010-4b61-92e7-d16359dd9da3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.107282 Aug 27 03:39:49.894676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 577/1190] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:49 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:39:50.004787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:50.006389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:50.013367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:50.013812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:50.014613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:50.015074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:50.102330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f061e9c3-850b-497e-b258-80634f06c3f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.102506 Aug 27 03:39:50.102988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 614/1191] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:49 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:50.906849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:50.907755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:50.914699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:50.915161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:50.915913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:50.916333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:51.006867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cee0c610-f45b-4483-9bbf-3b73a89a0dd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.103948 Aug 27 03:39:51.007513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 578/1192] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:50 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:51.116109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:51.117113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:51.123576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:51.124019 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:51.124786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:51.125220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:51.226097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6ede0162-e9aa-40f9-b1f9-3a380864d611 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.114342 Aug 27 03:39:51.226702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 615/1193] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:51 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:52.019126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:52.020251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:52.026705 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:52.027143 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:52.027898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:52.028323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:52.112088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-23ebd343-b7cb-48c5-bc71-1b2c6f81bef3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.096864 Aug 27 03:39:52.112726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 579/1194] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:52 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:52.238392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:52.239637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:52.246539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:52.246984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:52.247764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:52.248194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:52.348594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0fc1157b-be7e-4072-9565-73fc1f5caca5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.114079 Aug 27 03:39:52.349177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 616/1195] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:52 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:53.125973 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:53.127000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:53.133446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:53.133891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:53.134681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:53.135115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:53.224680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2f9458b5-b3d1-422b-9c8a-3428fcbc9731 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.103457 Aug 27 03:39:53.225327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 580/1196] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:53 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:53.360695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:53.362078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:53.369463 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:53.369906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:53.370686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:53.371111 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:53.452953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c62c4dad-680c-41bf-b5ba-0dcd6b8b1a81 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.096088 Aug 27 03:39:53.453511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 617/1197] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:53 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:39:54.237115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:54.238219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:54.245595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:54.246061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:54.246841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:54.247303 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:54.333236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6d3e301e-a146-4343-bd2b-f64e4f415964 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.100024 Aug 27 03:39:54.333882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 581/1198] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:54 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:54.464932 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:54.465927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:54.472315 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:54.472778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:54.473628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:54.474079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:54.556917 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0c6ba13a-5bbf-4362-9ac4-bdc91b771242 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.095756 Aug 27 03:39:54.557681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 618/1199] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:54 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:55.345091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:55.346169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:55.352852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:55.353292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:55.354083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:55.354508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:55.453854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b09cacc6-11c1-428d-ae3e-2c1ef7be3e1f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.112727 Aug 27 03:39:55.454829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 582/1200] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:55 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:55.569981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:55.571125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:55.577952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:55.578419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:55.579192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:55.579616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:55.670412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5749e0b4-e27f-479f-83de-2f4008097b7e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.105056 Aug 27 03:39:55.671308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 619/1201] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:55 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:56.466920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:56.467976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:56.475719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:56.476304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:56.476911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:56.477340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:56.570410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5a94d75b-a9b2-4e06-9ee1-72e9d174a5cb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.107317 Aug 27 03:39:56.571066 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 583/1202] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:56 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:56.683187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:56.684221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:56.691012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:56.691538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:56.692945 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:56.693380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:56.777652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-abc9621e-0b96-4ecb-a061-c63c0bb30b58 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.098381 Aug 27 03:39:56.778379 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 620/1203] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:56 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:57.583356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:57.584347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:57.590894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:57.591335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:57.592120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:57.592549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:57.676985 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4307fee5-4e5f-4218-b98a-5176e2f2faa7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.098071 Aug 27 03:39:57.677610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 584/1204] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:57 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:57.789821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:57.790838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:57.797178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:57.797608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:57.798387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:57.798809 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:57.902005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c80cd484-70e1-4797-8de5-aab369266db3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.116098 Aug 27 03:39:57.902825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 621/1205] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:57 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:58.689318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:58.690437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:58.697398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:58.697848 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:58.698649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:58.699086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:58.792335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e4808fee-0d9f-45ca-b3d0-10011c8b13d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.107159 Aug 27 03:39:58.792977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 585/1206] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:58 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:39:58.914245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:58.915275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:58.923734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:58.924187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:58.924972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:58.925432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:59.018582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ed123d3f-7453-47d0-aefb-7862efc098a1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.108338 Aug 27 03:39:59.019237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 622/1207] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:39:58 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:59.805010 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:59.806006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:39:59.812511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:59.812880 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:59.813910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:39:59.814368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:39:59.905528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ecad7d01-aaad-49c2-aef2-cc02b51c6889 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.104902 Aug 27 03:39:59.906194 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 586/1208] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:39:59 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:00.031357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:00.032372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:00.039039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:00.039476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:00.040226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:00.040646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:00.125559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d70a390-b3d7-44de-b696-6cb4bdf5a001 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.097993 Aug 27 03:40:00.126133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 623/1209] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:00 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:00.917418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:00.918366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:00.924801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:00.925241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:00.926719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:00.927172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:01.022410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-33a36452-9c8a-492a-83c2-860bd7e9c3cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.108930 Aug 27 03:40:01.023050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 587/1210] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:00 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:01.137727 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:01.138746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:01.145787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:01.146262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:01.147023 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:01.147451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:01.231527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-500be700-086a-4a3e-a667-68cd00d69aa1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.097671 Aug 27 03:40:01.232202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 624/1211] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:01 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:02.034431 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:02.035528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:02.042087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:02.042528 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:02.043279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:02.043703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:02.134155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8fe2d2f5-e736-425c-b192-5204bfc6bd2b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.103471 Aug 27 03:40:02.134790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 588/1212] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:02 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:02.244259 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:02.245210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:02.251668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:02.252108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:02.252865 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:02.253294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:02.336960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7488a9d1-1d63-4119-8525-98f7d653f46f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 28651 microversion: 2.20 time: 0.096663 Aug 27 03:40:02.337612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 625/1213] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:02 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 28651 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:03.145305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:03.146323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:03.152775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:03.153223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:03.154041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:03.154475 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:03.256834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e38d087d-110a-4609-979c-ee767ef0ab55 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.115423 Aug 27 03:40:03.257466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 589/1214] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:03 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:03.349958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:03.350926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:03.357328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:03.357764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:03.358710 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:03.358991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:03.456333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-36b3f359-7f63-4825-8305-f547c10c711f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 30560 microversion: 2.20 time: 0.110921 Aug 27 03:40:03.457907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 626/1215] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:03 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 30560 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:04.268025 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:04.269032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:04.275792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:04.276301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:04.277142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:04.277614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:04.371604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1e99941c-173c-42be-872e-14fa1149e929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.107476 Aug 27 03:40:04.372273 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 590/1216] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:04 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:04.469333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:04.470355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:04.477391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:04.477840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:04.478625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:04.479050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:04.572065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-279fa711-e1d7-4b81-bcc6-721dff6a1117 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 32541 microversion: 2.20 time: 0.106684 Aug 27 03:40:04.572750 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 627/1217] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:04 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 32541 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:05.385062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:05.386235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:05.392912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:05.393375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:05.394164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:05.394637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:05.503131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-60a8c658-baaf-4638-aa3d-46ec3a4a965a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.122369 Aug 27 03:40:05.503786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 591/1218] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:05 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:05.584261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:05.585256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:05.591644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:05.592078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:05.592829 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:05.593253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:05.686646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-49224f88-8022-4fe9-80ba-16efc844dfd3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 33633 microversion: 2.20 time: 0.106328 Aug 27 03:40:05.687333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 628/1219] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:05 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 33633 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:06.516318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:06.517313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:06.524627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:06.525073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:06.525840 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:06.526305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:06.622780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d1a081a6-567d-4ed3-9e23-278f2a96c7dc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.110297 Aug 27 03:40:06.623436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 592/1220] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:06 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:06.699173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:06.700175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:06.706601 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:06.707821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:06.708511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:06.708941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:06.818824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-130e2422-633c-4bbc-81e8-bbf0a394ee76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 34791 microversion: 2.20 time: 0.123334 Aug 27 03:40:06.819390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 629/1221] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:06 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 34791 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:07.635749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:07.636759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:07.643322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:07.643765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:07.644585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:07.645191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:07.736673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e62b408c-5c1f-4850-b64e-90c76ef8cd0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.104844 Aug 27 03:40:07.737564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 593/1222] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:07 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:40:07.831302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:07.832284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:07.838779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:07.839228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:07.839998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:07.840429 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:07.935046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2eda62a4-1962-46f2-84d3-162db06cb6f4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 35930 microversion: 2.20 time: 0.107733 Aug 27 03:40:07.935725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 630/1223] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:07 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 35930 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:08.749440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:08.750459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:08.757862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:08.758323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:08.759085 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:08.759514 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:08.846533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e41c1b1d-6550-43db-b599-492ac7e744d7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.100597 Aug 27 03:40:08.847216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 594/1224] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:08 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:08.948792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:08.949797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:08.956269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:08.956710 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:08.958278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:08.958700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:09.071040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-66c791bd-9843-49d9-b67e-0152cb428b59 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 37627 microversion: 2.20 time: 0.126145 Aug 27 03:40:09.072007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 631/1225] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:08 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 37627 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:09.859209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:09.860146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:09.867035 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:09.867487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:09.868253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:09.868688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:09.961114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8f0b235f-28b2-4cb0-b09c-42f49d66bfc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.105873 Aug 27 03:40:09.961863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 595/1226] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:09 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:10.083425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:10.084417 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:10.090982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:10.091420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:10.092173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:10.092599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:10.189052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bb455c76-f3ea-49eb-9daa-a6848130e181 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 38210 microversion: 2.20 time: 0.109295 Aug 27 03:40:10.189611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 632/1227] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:10 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 38210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:10.973934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:10.974852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:10.981263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:10.981710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:10.982511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:10.982946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:11.073516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b99840ef-3e17-408f-b48d-be1c08721ec0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 28624 microversion: 2.1 time: 0.104082 Aug 27 03:40:11.074172 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 596/1228] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:10 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 28624 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:11.201635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:11.202682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:11.209815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:11.210288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:11.211048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:11.211476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:11.305438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f0cfb921-b027-4487-8cd3-3bfafe80f56e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 38210 microversion: 2.20 time: 0.107648 Aug 27 03:40:11.306130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 633/1229] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:11 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 38210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:12.085749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:12.086755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:12.093216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:12.093656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:12.094457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:12.094890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:12.205504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-071e6708-0408-4c2e-800c-949756241a4d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 29531 microversion: 2.1 time: 0.123855 Aug 27 03:40:12.206169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 597/1230] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:12 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 29531 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:12.318965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:12.319968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:12.326517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:12.326961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:12.327732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:12.328159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:12.416680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-14b691f7-8f22-4409-9a03-817d307867f6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 38210 microversion: 2.20 time: 0.102148 Aug 27 03:40:12.417244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 634/1231] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:12 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 38210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:40:13.217530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:13.218590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:13.226667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:13.227124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:13.228075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:13.228362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:13.343950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8d382d64-1fc5-49ff-add2-36101ffb68fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 31402 microversion: 2.1 time: 0.130239 Aug 27 03:40:13.344599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 598/1232] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:13 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 31402 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:40:13.430159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:13.431401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:13.442904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:13.443674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:13.445043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:13.445747 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:13.534460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-debc0442-cb77-43e7-8874-7e81db734075 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 38210 microversion: 2.20 time: 0.109058 Aug 27 03:40:13.535705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 635/1233] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:13 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 38210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:14.356687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:14.357683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:14.364270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:14.364715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:14.365489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:14.365897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:14.471895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-86b76774-251b-4aab-855d-10b289c16bbc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 32961 microversion: 2.1 time: 0.119179 Aug 27 03:40:14.472547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 599/1234] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:14 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 32961 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:14.547609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:14.548641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:14.555422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:14.555869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:14.556647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:14.557078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:14.672305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8c1e4e21-e0e2-4ae7-8f0c-328332dc4ad6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 200 len: 38353 microversion: 2.20 time: 0.128557 Aug 27 03:40:14.673136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 636/1235] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:14 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 38353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:14.684046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:14.684637 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:14.692047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:14.692563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:14.693440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:14.693873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:14.717770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e566305a-24d3-4d2e-9211-dd2557161e23 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/ips" status: 200 len: 151 microversion: 2.20 time: 0.037677 Aug 27 03:40:14.718391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 600/1236] 10.222.0.48 () {60 vars in 1289 bytes} [Fri Aug 27 03:40:14 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:15.484904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:15.485909 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:15.492715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:15.493167 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:15.493936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:15.494398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:15.590422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9ada36d9-14b3-4909-b9d9-a4392405fd21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 33828 microversion: 2.1 time: 0.109361 Aug 27 03:40:15.591115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 637/1237] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:15 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 33828 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:16.602660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:16.603604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:16.610072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:16.610518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:16.611280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:16.611710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:16.707537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b6bdd88d-1e50-4095-81ae-2614ee32e347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 35074 microversion: 2.1 time: 0.107871 Aug 27 03:40:16.708505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 601/1238] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:16 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 35074 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:17.097473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:17.099240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:17.106357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:17.106808 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:17.107599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:17.108031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:17.131040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lazy-loading 'flavor' on Instance uuid c750bdb9-76a6-4631-89d9-78c4128f6c67 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:40:17.387735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-78834f1c-1202-4bd7-aae9-cd80e82edcb2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 202 len: 0 microversion: 2.20 time: 0.294232 Aug 27 03:40:17.388367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 638/1239] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:17 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:40:17.397226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:17.397910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:17.404152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:17.404546 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:17.405290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:17.405711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:17.530572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:17.539229 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:17.540703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:17.541821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c269282e-89ef-4991-963c-e9d82c04b711 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.149046 Aug 27 03:40:17.542415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 602/1240] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:17 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:17.719775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:17.720783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:17.727277 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:17.727537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:17.728544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:17.728981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:17.849347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d6d674b5-51bb-4c3d-9631-aa3409a5babb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 36451 microversion: 2.1 time: 0.133440 Aug 27 03:40:17.850325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 639/1241] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:17 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 36451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:18.560582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:18.561197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:18.568155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:18.568609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:18.569386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:18.569819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:18.696956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:18.704657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:18.706174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:18.707976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7206ee13-6a1a-4850-b54a-437cc4eea962 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.151184 Aug 27 03:40:18.708642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 603/1242] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:18 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:18.861598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:18.862715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:18.869297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:18.869743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:18.870531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:18.870963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:18.970352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-df65fe45-6752-4e54-94a5-77dba9d1d723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 37968 microversion: 2.1 time: 0.111978 Aug 27 03:40:18.970685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 640/1243] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:18 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 37968 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:19.726695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:19.727305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:19.733144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:19.733588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:19.734377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:19.734810 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:19.852799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:19.860540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:19.862052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:19.863639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6e592f7b-e0b3-465b-9606-397a1da73754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.141024 Aug 27 03:40:19.864298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 604/1244] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:19 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:19.982791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:19.983788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:19.990402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:19.990841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:19.991607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:19.992038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:20.097496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-86151844-9cba-4b6c-89c2-7a0e79d01416 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 38155 microversion: 2.1 time: 0.118475 Aug 27 03:40:20.098752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 641/1245] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:19 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 38155 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:20.882430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:20.883084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:20.889292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:20.889736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:20.890531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:20.890967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:21.011764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:21.019427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:21.021075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:21.022243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8f7e05ea-4aa5-4d9f-a8a1-f7841e73fff6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.144493 Aug 27 03:40:21.022804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 605/1246] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:20 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:21.110539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:21.111544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:21.118763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:21.119209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:21.119979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:21.120414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:21.213680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b8ce39b4-bf1f-4c1e-8aec-4281f11830e5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 38155 microversion: 2.1 time: 0.107006 Aug 27 03:40:21.214284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 642/1247] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:21 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 38155 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:22.040174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:22.040807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:22.046800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:22.047244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:22.048003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:22.048440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:22.176203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:22.183977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:22.185459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:22.186619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-479d70b9-8da9-47a0-9330-f5af29b6c5f3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.150215 Aug 27 03:40:22.187175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 606/1248] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:22 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:40:22.225938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:22.227388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:22.234175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:22.234619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:22.235402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:22.235820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:22.322689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3bfd0f73-f109-4958-9935-135ac666a09a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 38155 microversion: 2.1 time: 0.100567 Aug 27 03:40:22.323268 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 643/1249] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:22 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 38155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:40:23.205505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:23.206140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:23.212178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:23.212620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:23.213378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:23.213805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:23.334992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:23.335801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:23.336025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:23.342369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:23.342812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:23.343575 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:23.343691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:23.344004 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:23.345154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:23.346317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6ab26d4d-fc40-494f-bbc3-d165543fc8f9 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.144631 Aug 27 03:40:23.346871 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 607/1250] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:23 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:23.436350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a9963dbf-26c8-4525-b282-23c8b278306f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 38284 microversion: 2.1 time: 0.105342 Aug 27 03:40:23.436992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 644/1251] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:40:23 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 38284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:40:23.446918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:23.447412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:23.453199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:23.453641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:23.454431 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:23.454865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:23.478301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e6e0aeb9-c33c-4eef-b98d-98c73998c962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/ips" status: 200 len: 146 microversion: 2.1 time: 0.034878 Aug 27 03:40:23.478788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 608/1252] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Aug 27 03:40:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:24.366408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:24.367107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:24.373462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:24.373911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:24.374701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:24.375132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:24.507868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:24.518467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:24.521188 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:24.522380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d326b5f0-a864-41a6-9508-2d44fd4a5dc6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.161303 Aug 27 03:40:24.522952 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 645/1253] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:24 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:24.802408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77656960-e634-4acf-a78c-eab6cb439574"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:24.803453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:24.810432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:24.810918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:24.811693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:24.812122 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:25.098547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-95530306-fce6-4c72-aa12-4766aef6d922 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299869 Aug 27 03:40:25.099149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 609/1254] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 03:40:24 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:25.542075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:25.542728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:25.548972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:25.549416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:25.550231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:25.551278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:25.678326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.686148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.687628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.689062 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dfec4cb8-0b73-4f1c-ad02-2749ab1d97bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.150908 Aug 27 03:40:25.689812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 646/1255] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:25 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:26.708506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:26.709200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:26.716162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:26.716602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:26.717369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:26.717799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:26.837896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:26.845586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:26.847103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:26.848849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d7410b24-f73b-4582-8912-d4232a05c523 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.145692 Aug 27 03:40:26.849411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 610/1256] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:26 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:27.866853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:27.867395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:27.873633 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:27.874103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:27.874873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:27.875305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:27.997873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:28.006052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:28.007545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:28.008679 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-02805ac2-147c-4e15-aca4-68fe8c3ccb34 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.145703 Aug 27 03:40:28.009237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 647/1257] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:27 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:29.026530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:29.027121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:29.033345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:29.033787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:29.034570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:29.035052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:29.158390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:29.167103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:29.168583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:29.169722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d21183a3-bee7-4f76-957d-f6170bde6754 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1743 microversion: 2.20 time: 0.146966 Aug 27 03:40:29.170314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 611/1258] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:29 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1743 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:30.188655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:30.189217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:30.195323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:30.195770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:30.196530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:30.196965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:30.320170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:30.328660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:30.330263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:30.331399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-17316182-1012-4cf4-a3e4-5f88bbee32e1 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1743 microversion: 2.20 time: 0.146896 Aug 27 03:40:30.331990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 648/1259] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:30 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1743 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:31.350482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:31.351075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:31.356918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:31.357368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:31.358163 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:31.358600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:31.481323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:31.489458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:31.490991 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:31.492143 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6402f957-b438-46ad-9f7e-9af151359c5e tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1743 microversion: 2.20 time: 0.146539 Aug 27 03:40:31.492689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 612/1260] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:31 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1743 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:32.456927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-62144288-b944-462d-aac4-6118f32f182d req-17bc9338-56de-4eb5-a3b4-9e8ab375f25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "name": "network-vif-plugged", "status": "completed", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:32.458479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:40:32.458479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:40:32.466366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-62144288-b944-462d-aac4-6118f32f182d req-17bc9338-56de-4eb5-a3b4-9e8ab375f25b service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:32.466819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-62144288-b944-462d-aac4-6118f32f182d req-17bc9338-56de-4eb5-a3b4-9e8ab375f25b service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:32.478690 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-62144288-b944-462d-aac4-6118f32f182d req-17bc9338-56de-4eb5-a3b4-9e8ab375f25b service nova] Creating event network-vif-plugged:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:40:32.483631 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-62144288-b944-462d-aac4-6118f32f182d req-17bc9338-56de-4eb5-a3b4-9e8ab375f25b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030421 Aug 27 03:40:32.484237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 649/1261] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:40:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:32.509486 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:32.510114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:32.516157 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:32.516590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:32.517543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:32.518239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:32.648885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.656479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.657948 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.659116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-28e6aa4c-17db-47b5-88a0-3e64359478be tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1743 microversion: 2.20 time: 0.153176 Aug 27 03:40:32.659670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 613/1262] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:32 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:33.677983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:33.678731 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:33.684994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:33.685435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:33.686235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:33.686665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:33.814744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:33.822884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:33.824391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:33.825535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d94b98d1-13a7-4e1b-adbe-fbcbf48f6a32 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1743 microversion: 2.20 time: 0.151625 Aug 27 03:40:33.826117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 650/1263] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:33 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:34.846606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:34.847799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:34.857311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:34.857759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:34.858569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:34.858999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:34.996370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:35.005379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:35.007152 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:35.008328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-461e5f3b-cde0-47a2-a8f9-633150f0ef8d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.168090 Aug 27 03:40:35.008898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 614/1264] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:34 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:36.026634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:36.027300 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:36.036229 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:36.037007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:36.037974 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:36.038567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:36.335282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:36.343915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:36.345404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:36.346656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-17952ac8-6ec4-4e56-a5f7-ebe7faf7d042 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.323651 Aug 27 03:40:36.347231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 651/1265] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:36 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:37.365557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:37.366274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:37.372337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:37.372788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:37.373617 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:37.374071 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:37.542208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:37.551230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:37.553133 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:37.554685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c546bccc-c84a-435b-bdd5-656e1a672743 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.193742 Aug 27 03:40:37.566260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 615/1266] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:37 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:38.573061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:38.574380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:38.584123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:38.585147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:38.586170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:38.586792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:38.740011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:38.748728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:38.750608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:38.751965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-08666952-add2-4016-b708-fd7603f6a81f tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.183087 Aug 27 03:40:38.752811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 652/1267] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:38 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:39.771936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:39.772678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:39.779283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:39.779740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:39.780599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:39.781063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:39.943422 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:39.951553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:39.953046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:39.954209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bba62692-2480-4e7c-979b-b36faaaf8422 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.187065 Aug 27 03:40:39.954768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 616/1268] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:39 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:40.972374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:40.974495 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:40.981082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:40.981652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:40.982540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:40.983239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:41.118372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:41.127120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:41.129418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:41.130661 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ff600a6d-31a2-4eac-af14-1dc20d1ebe5c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.162197 Aug 27 03:40:41.131453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 653/1269] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:40 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:42.148717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:42.149341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:42.160385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:42.160385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:42.160385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:42.160385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:42.292650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:42.301857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:42.303607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:42.304970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d3f4787d-5c78-4ffa-bfda-fd8bc968f280 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.159967 Aug 27 03:40:42.310344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 617/1270] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:42 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:43.323679 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:43.324419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:43.331212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:43.331712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:43.332695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:43.333219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:43.476628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:43.485034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:43.486545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:43.488283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4ed935af-a346-4ff9-8fd5-1f184c9bb5f8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1738 microversion: 2.20 time: 0.168188 Aug 27 03:40:43.489533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 654/1271] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:43 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:44.509043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:44.509659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:44.516113 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:44.516490 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:44.517265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:44.517696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:44.747642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:44.756165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:44.757639 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:44.758798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-328bc369-e56f-4e29-9d9f-b549b79570ef tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1720 microversion: 2.20 time: 0.253544 Aug 27 03:40:44.759368 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 618/1272] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:44 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:45.777930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:45.778577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:45.784802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:45.785319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:45.786357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:45.786799 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:45.910067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:45.918039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:45.919514 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:45.920647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bd56729a-e06d-4b89-a46d-2b445a9a06bd tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1720 microversion: 2.20 time: 0.146775 Aug 27 03:40:45.921191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 655/1273] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:45 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:46.521644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-8986f34d-96c3-4564-99a6-df973046128e req-3cfee295-e373-492b-9f02-af1e841354b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "name": "network-vif-unplugged", "status": "completed", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:46.523251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:40:46.523251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:40:46.530335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-8986f34d-96c3-4564-99a6-df973046128e req-3cfee295-e373-492b-9f02-af1e841354b9 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:46.530775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-8986f34d-96c3-4564-99a6-df973046128e req-3cfee295-e373-492b-9f02-af1e841354b9 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:46.544110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-8986f34d-96c3-4564-99a6-df973046128e req-3cfee295-e373-492b-9f02-af1e841354b9 service nova] Creating event network-vif-unplugged:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:40:46.549090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-8986f34d-96c3-4564-99a6-df973046128e req-3cfee295-e373-492b-9f02-af1e841354b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031054 Aug 27 03:40:46.549680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 619/1274] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:40:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:46.939045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:46.939664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:46.946200 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:46.946645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:46.947416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:46.947846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.073017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:47.080849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:47.082890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:47.085161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-57c0ee0d-49ee-433f-b5d7-8e8a52d082e2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1723 microversion: 2.20 time: 0.149716 Aug 27 03:40:47.085411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 656/1275] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:46 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:47.103199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78571c98-045f-4c14-a882-6df2b5fed66b"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:47.104388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:47.110964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.111407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.112179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.112625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.382844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-71b275fd-373b-4725-9562-c50f088468d4 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283786 Aug 27 03:40:47.383460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 620/1276] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Aug 27 03:40:47 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:40:47.510419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:47.510911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:47.517192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.517646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.518527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.518969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.762635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-566b0377-0695-484a-ac26-783a154c494d tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-volume_attachments/78571c98-045f-4c14-a882-6df2b5fed66b" status: 202 len: 0 microversion: 2.20 time: 0.256083 Aug 27 03:40:47.763227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 657/1277] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Aug 27 03:40:47 2021] DELETE /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-volume_attachments/78571c98-045f-4c14-a882-6df2b5fed66b => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:40:47.821984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:47.822591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:47.829004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.829456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.830261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.830695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.910483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c7eec833-0245-4f9a-baa5-bcfde4c9be76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action" status: 202 len: 0 microversion: 2.20 time: 0.092184 Aug 27 03:40:47.911102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 621/1278] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Aug 27 03:40:47 2021] POST /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:40:47.919000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:47.919636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:47.925956 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.927083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:47.927985 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:47.928318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:48.087557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:48.095761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:48.097767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:48.099165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ca32251e-6890-4372-8659-46d88b5f5634 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1671 microversion: 2.20 time: 0.183742 Aug 27 03:40:48.099832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 658/1279] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:47 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1671 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:49.119190 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:49.119815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:49.126218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:49.126690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:49.127535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:49.127964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:49.302425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:49.310743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:49.312343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:49.313731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-61bb2183-06b4-409f-9be2-ee72efca2dfe tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.198251 Aug 27 03:40:49.314336 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 622/1280] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:49 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:50.333923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:50.335063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:50.341936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:50.342546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:50.343513 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:50.344044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:50.471517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:50.500238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:50.502436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:50.504003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8cf99861-9543-4966-96d8-6a030668940a tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.174368 Aug 27 03:40:50.507227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 659/1281] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:50 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:40:51.522727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:51.523480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:51.530113 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:51.530644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:51.531561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:51.532046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:51.691997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:51.700573 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:51.701944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:51.703165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b3b5f248-297c-4a21-9408-723ccad05f93 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.185148 Aug 27 03:40:51.703729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 623/1282] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:51 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:52.722771 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:52.723950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:52.729560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:52.729560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:52.729560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:52.732801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:52.877014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:52.885933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:52.887452 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:52.888593 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4d72808a-6e67-4b9a-8b12-1866aabde2bf tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.170263 Aug 27 03:40:52.889153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 660/1283] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:52 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:53.907238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:53.907893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:53.915369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:53.915854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:53.916672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:53.917129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:54.052962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:54.061394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:54.062851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:54.064281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-810a51be-aabf-472a-88ee-4c0041b2dbd6 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.161045 Aug 27 03:40:54.064842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 624/1284] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:53 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:55.085340 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:55.086002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:55.092660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:55.093245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:55.094250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:55.094778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:55.233681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:55.241732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:55.243258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:55.244404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-07478fd5-4dc7-448a-96f7-73e371913592 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.163603 Aug 27 03:40:55.244967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 661/1285] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:55 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:56.265151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:56.265744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:56.272483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:56.272927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:56.273715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:56.274178 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:56.418491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:56.426762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:56.428265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:56.429432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5ef5d27d-10c5-48aa-b8b5-dfbce8390c87 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.170571 Aug 27 03:40:56.430000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 625/1286] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:56 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:57.449209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:57.449912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:57.457733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:57.458221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:57.459028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:57.459467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:57.601383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:57.609273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:57.610739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:57.611877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-94bb96a3-75fe-4b44-b679-0b0ca78b5c76 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.167226 Aug 27 03:40:57.612447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 662/1287] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:57 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:40:58.630802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:58.631410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:58.637448 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:58.638240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:58.638978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:58.639438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:58.774764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:58.782930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:58.784979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:58.786268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e6d2f31d-ca62-4530-9245-2fe457df2cc2 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.159239 Aug 27 03:40:58.786838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 626/1288] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:58 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:40:59.804377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:59.805113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:40:59.811781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:59.812273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:59.813179 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:40:59.813960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:40:59.943722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:59.951627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:59.953042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:59.954206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-59998d6a-1009-4990-82db-c95cae0b6af8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.154185 Aug 27 03:40:59.954752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 663/1289] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:40:59 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:00.973189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:00.973737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:00.980217 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:00.980660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:00.981461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:00.981920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:01.112745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:01.121984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:01.123568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:01.124713 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-38e90b6a-445e-47bf-9c12-6b617bcba689 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.155868 Aug 27 03:41:01.125277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 627/1290] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:00 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:02.142487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:02.143095 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:02.149031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:02.149473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:02.150289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:02.150722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:02.272485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:02.280385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:02.281888 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:02.283576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cd49530c-7a6d-47d7-883b-8e8cf4861d89 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.144797 Aug 27 03:41:02.284143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 664/1291] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:02 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:03.303921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:03.304660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:03.311130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:03.311739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:03.312537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:03.312969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:03.464522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:03.472940 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:03.474484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:03.475640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c6898cba-7dfc-41aa-8b6c-e7ba50db3948 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.175822 Aug 27 03:41:03.476199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 628/1292] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:03 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:04.492855 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:04.493464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:04.499296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:04.499747 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:04.500517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:04.500948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:04.631091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:04.638963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:04.640472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:04.641626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0737e6c3-fd9c-43ce-ae37-863d846e88d5 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.152453 Aug 27 03:41:04.642208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 665/1293] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:04 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:05.661113 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:05.661726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:05.667599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:05.668044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:05.668808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:05.669232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:05.792141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:05.800126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:05.801779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:05.802960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d2b6d948-1438-494a-9707-8fdc4dd7c60c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.146234 Aug 27 03:41:05.803533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 629/1294] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:05 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:06.681236 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-45d6d654-f7af-4c1e-b4e1-d2fc6b683e7a req-d9265982-fbb1-4b4b-8dbe-c380eb1583e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "name": "network-vif-plugged", "status": "completed", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:06.682795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:41:06.682795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:41:06.690096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-45d6d654-f7af-4c1e-b4e1-d2fc6b683e7a req-d9265982-fbb1-4b4b-8dbe-c380eb1583e8 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:06.691721 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-45d6d654-f7af-4c1e-b4e1-d2fc6b683e7a req-d9265982-fbb1-4b4b-8dbe-c380eb1583e8 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:06.702386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-45d6d654-f7af-4c1e-b4e1-d2fc6b683e7a req-d9265982-fbb1-4b4b-8dbe-c380eb1583e8 service nova] Creating event network-vif-plugged:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:41:06.707551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-45d6d654-f7af-4c1e-b4e1-d2fc6b683e7a req-d9265982-fbb1-4b4b-8dbe-c380eb1583e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029889 Aug 27 03:41:06.708142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 666/1295] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:41:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:41:06.808789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:41:06.809012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:41:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:41:06.825391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:06.826187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:06.832029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:06.832472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:06.833246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:06.833678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:07.014110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:07.022447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:07.023947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:07.025083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f3a0a95b-19d4-4c03-8074-8e569a1f7cce tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.208170 Aug 27 03:41:07.025649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 630/1296] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:06 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:08.044079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:08.044773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:08.051174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:08.051615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:08.052391 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:08.052821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:08.181967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:08.190128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:08.192089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:08.193240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5c81fcb7-1427-4363-a501-f592da624b70 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1729 microversion: 2.20 time: 0.153226 Aug 27 03:41:08.193797 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 667/1297] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:08 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:09.212069 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:09.212703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:09.218557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:09.218999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:09.219765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:09.220195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:09.397033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:09.404825 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:09.406349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:09.407493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-668d214d-6e53-458a-b00f-3dd3831b1ec3 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1716 microversion: 2.20 time: 0.199142 Aug 27 03:41:09.408090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 631/1298] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:41:09 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1716 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:41:12.302042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:41:12.302822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:41:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:41:21.428521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:21.429435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:21.435411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:21.435849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:21.436609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:21.437034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:21.467097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c66d706c-127f-4203-9404-baea4d732d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Aug 27 03:41:21.467643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 668/1299] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:41:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:21.477351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:21.477896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:41:21.483792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:21.484252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:21.485021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:41:21.485452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:41:21.514887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ce302684-98e8-412d-bc45-a831ac87b90f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments/77656960-e634-4acf-a78c-eab6cb439574" status: 200 len: 194 microversion: 2.1 time: 0.041223 Aug 27 03:41:21.515463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 632/1300] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Aug 27 03:41:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments/77656960-e634-4acf-a78c-eab6cb439574 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:41:28.274598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:41:28.275173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:41:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:42:11.947380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:11.948293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:42:11.954222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:11.954663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:11.955935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:11.956366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:11.986938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d13dcafd-7c6f-4faf-a20e-c88626c2b80b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043281 Aug 27 03:42:11.987502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 669/1301] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Aug 27 03:42:11 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:12.047580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:12.048108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:42:12.053995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:12.054466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:12.055228 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:12.055658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:12.081500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:42:12.155935 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6342d91a-eedc-4468-b986-cb9ca1c08e7c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 204 len: 0 microversion: 2.20 time: 0.111784 Aug 27 03:42:12.156489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 633/1302] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Aug 27 03:42:12 2021] DELETE /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:42:12.164928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:12.165574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:42:12.171488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:12.171933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:12.172698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:12.173132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:12.347096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:12.362160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:12.363667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:12.364827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cbcf7ad2-be57-4a06-8bfd-99e98f25369c tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.203607 Aug 27 03:42:12.365453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 670/1303] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:42:12 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:42:13.383623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:13.384346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:42:13.390043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:13.390500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:13.391300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:13.391735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:13.519788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:13.527591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:13.529086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:13.530260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ff1c2612-f0d2-4920-9446-3526250e6774 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1722 microversion: 2.20 time: 0.150711 Aug 27 03:42:13.530813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 634/1304] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:42:13 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:42:14.548668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:14.550492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:42:14.556725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:14.557462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:14.557942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:14.558405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:14.651954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:14.660642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:14.662147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e0333e9dafb463c89094944cbba7689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9e1db2319a4a8d89c073898f70aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:14.663297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-63e0bec3-7361-44bd-8f1c-f5dd254c85b8 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 200 len: 1655 microversion: 2.20 time: 0.118467 Aug 27 03:42:14.663847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 671/1305] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:42:14 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 1655 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:42:14.916143 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-4c5985bc-fbc9-4adc-bf1a-b072075dc7fd req-781e7640-9892-48ad-8f36-834b77580098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c750bdb9-76a6-4631-89d9-78c4128f6c67", "name": "network-vif-deleted", "tag": "1f361cea-ce02-41b5-92b3-a484af96f49d"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:42:14.918114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:42:14.918114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:42:14.926902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-4c5985bc-fbc9-4adc-bf1a-b072075dc7fd req-781e7640-9892-48ad-8f36-834b77580098 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:14.927319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-4c5985bc-fbc9-4adc-bf1a-b072075dc7fd req-781e7640-9892-48ad-8f36-834b77580098 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:14.940267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-4c5985bc-fbc9-4adc-bf1a-b072075dc7fd req-781e7640-9892-48ad-8f36-834b77580098 service nova] Creating event network-vif-deleted:1f361cea-ce02-41b5-92b3-a484af96f49d for instance c750bdb9-76a6-4631-89d9-78c4128f6c67 on hv-cinder-77398 Aug 27 03:42:14.945595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-4c5985bc-fbc9-4adc-bf1a-b072075dc7fd req-781e7640-9892-48ad-8f36-834b77580098 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033203 Aug 27 03:42:14.946538 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 635/1306] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:42:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:42:15.680777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:15.681331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:42:15.687252 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:15.687696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:15.688790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:42:15.689222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:42:15.702666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] HTTP exception thrown: Instance c750bdb9-76a6-4631-89d9-78c4128f6c67 could not be found. Aug 27 03:42:15.703252 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Returning 404 to user: Instance c750bdb9-76a6-4631-89d9-78c4128f6c67 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:42:15.704071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5cc51064-2ee8-454f-bdab-fca33a7cf667 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 404 len: 111 microversion: 2.20 time: 0.027101 Aug 27 03:42:15.704600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 672/1307] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Aug 27 03:42:15 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:42:15.713883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-89f52ebc-8054-49d3-9219-76943ce61d56 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '.version_select at 0x7fb1305c7280>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:15.738138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-89f52ebc-8054-49d3-9219-76943ce61d56 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-889258898" status: 204 len: 0 microversion: 2.20 time: 0.026742 Aug 27 03:42:15.741033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 636/1308] 10.222.0.48 () {60 vars in 1259 bytes} [Fri Aug 27 03:42:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-889258898 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:44:26.827419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:44:26.828096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:44:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:44:48.291311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:44:48.291995 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:44:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:44:53.596601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:44:53.597242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:44:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:46:09.633250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:46:09.634782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:46:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:46:36.233919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:46:36.234535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:46:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:47:21.604825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:47:21.608587 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:21.609069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:21.616488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:21.616924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:21.617682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:21.618139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:21.763872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lazy-loading 'services' on Instance uuid e1ffde52-808b-45c5-8e77-3a763ad6db4c {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:47:21.829053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f944fdfe-a8de-4658-b662-5c750fbe7955 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments/77656960-e634-4acf-a78c-eab6cb439574" status: 202 len: 0 microversion: 2.1 time: 0.225563 Aug 27 03:47:21.829646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 673/1309] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 03:47:21 2021] DELETE /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments/77656960-e634-4acf-a78c-eab6cb439574 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:47:21.837398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:47:21.841656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:21.842770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:21.849322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:21.851048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:21.851866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:21.852328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:21.884655 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-49520b1a-833d-4953-a7a7-e1839e124fb1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050703 Aug 27 03:47:21.885220 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 637/1310] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:22.906475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:22.907528 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:22.915401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:22.915843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:22.916611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:22.917033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:22.933043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47994. Aug 27 03:47:22.949712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-32a9af00-d3d9-48e3-95cc-e48090786d8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057111 Aug 27 03:47:22.950304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 674/1311] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:23.960869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:23.961786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:23.983363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:23.984045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:23.984869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:23.985397 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:23.990787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 48002. Aug 27 03:47:24.019475 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-04653a06-a640-4100-b1c0-20460279951e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062500 Aug 27 03:47:24.020037 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 638/1312] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:25.031939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:25.033103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:25.040001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:25.040531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:25.041309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:25.041736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:25.075191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f9beafd0-f512-4682-aedb-d72fcfc46ccf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047175 Aug 27 03:47:25.075778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 675/1313] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:26.086797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:26.087700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:26.093448 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:26.093888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:26.094682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:26.095110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:26.125555 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ed4445ab-7ed6-4019-a48d-396e2e304d79 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Aug 27 03:47:26.126034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 639/1314] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:27.136833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:27.137765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:27.143842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:27.144280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:27.145055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:27.145481 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:27.175768 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ba3c9b30-b03f-4f58-b00c-8365438d32f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042775 Aug 27 03:47:27.176317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 676/1315] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:28.187687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:28.188600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:28.194372 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:28.194820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:28.195612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:28.196046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:28.226916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0bca47e9-5e4f-44ae-a08c-dcb7be6ee4f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Aug 27 03:47:28.227661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 640/1316] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:29.237486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:29.238446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:29.244381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:29.244820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:29.245625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:29.246044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:29.277834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c35ff27e-cf55-422c-b249-5c473f112d2f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Aug 27 03:47:29.278421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 677/1317] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:30.290135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:30.291046 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:30.298532 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:30.299467 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:30.300654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:30.300931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:30.332862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f957e0ee-8386-4e88-981f-8469941a9f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046995 Aug 27 03:47:30.333426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 641/1318] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:31.344674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:31.345606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:31.352263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:31.352707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:31.353484 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:31.353916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:31.383378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fe88e5ef-0b93-424a-a855-398f9e43f0c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Aug 27 03:47:31.383929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 678/1319] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:32.393937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:32.394887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:32.400782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:32.401274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:32.402444 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:32.402882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:32.437612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-41e41376-942b-43ef-8f8f-4d2c4ebe6838 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047245 Aug 27 03:47:32.440582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 642/1320] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:33.449966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:33.450911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:33.456633 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:33.457076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:33.457839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:33.458291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:33.496413 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3b379a58-1270-467b-8e3b-ac12cee37ab6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050121 Aug 27 03:47:33.496978 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 679/1321] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:34.507362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:34.508349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:34.514064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:34.514503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:34.515268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:34.515693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:34.545008 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0690dc87-a1a9-4b02-b8e8-c7a18daf65db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Aug 27 03:47:34.545554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 643/1322] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:35.561218 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:35.562190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:35.568275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:35.569159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:35.570521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:35.570961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:35.604227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d79f1970-21c9-4062-b0c8-6155634392bd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046671 Aug 27 03:47:35.604834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 680/1323] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:47:36.615905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:36.616839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:36.622656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:36.623097 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:36.623886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:36.624313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:36.655878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9bde9f22-711e-414d-b20e-7ce2f846169e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Aug 27 03:47:36.656675 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 644/1324] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:37.667179 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:37.668098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:37.673773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:37.674255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:37.675038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:37.675468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:37.705775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-835d559f-eb27-405d-a305-78133aeb6c1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 Aug 27 03:47:37.706353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 681/1325] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:38.717228 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:38.718204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:38.723908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:38.724838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:38.725294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:38.725726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:38.755679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b6aabadc-54ca-40ea-acf6-c9494669bc15 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041846 Aug 27 03:47:38.756717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 645/1326] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:39.767673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:39.768621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:39.774914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:39.775354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:39.776121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:39.776549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:39.805793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-503704be-17ca-4afb-8451-f71bde76feee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 Aug 27 03:47:39.806351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 682/1327] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:39 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:40.816769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:40.818340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:40.824031 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:40.824472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:40.825226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:40.825653 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:40.855256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-95598002-445a-40c7-83f0-b1b4e91e7b31 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Aug 27 03:47:40.855803 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 646/1328] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:41.867416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:41.868338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:41.874125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:41.874576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:41.875353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:41.875785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:41.907103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5de75b26-b051-4360-b0e3-0a4f36a8c48a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 27 03:47:41.907729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 683/1329] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:42.922055 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:42.923469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:42.932763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:42.933254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:42.934057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:42.934694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:42.967657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a51703d1-ec46-469a-aca2-f5494759bd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051829 Aug 27 03:47:42.968234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 647/1330] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:47:43.984204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:43.985965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:43.996883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:43.997648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:43.999155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:43.999926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:44.048160 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9e1385f8-62d7-4960-b7dd-9a7ecc47e1af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070956 Aug 27 03:47:44.049482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 684/1331] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:43 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:45.062461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:45.063790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:45.072073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:45.072740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:45.073694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:45.074308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:45.112483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7d7351f2-8a19-4971-986e-c66187bb95bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054453 Aug 27 03:47:45.113195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 648/1332] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:47:46.126184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:46.127124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:46.135936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:46.136798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:46.138477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:46.139418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:46.178891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-312970ec-ef96-4b09-8c9f-a3744fda6fb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056809 Aug 27 03:47:46.179442 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 685/1333] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:46.846082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:47:46.846323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:47:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:47:47.191328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:47.193251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:47.201374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:47.201857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:47.203155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:47.204112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:47.251874 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6250cd3e-1f3c-4884-bf78-aadd96f28117 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064540 Aug 27 03:47:47.252454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 649/1334] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:48.270037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:48.271431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:48.279297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:48.279749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:48.283066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:48.283066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:48.319335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1b36232f-724a-4679-9e4e-b3e04db55fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057075 Aug 27 03:47:48.319919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 686/1335] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:49.331441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:49.332361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:49.339109 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:49.339467 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:49.340291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:49.340748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:49.377638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ca4a05bf-f4f1-443e-87b1-77f78ba0a844 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049836 Aug 27 03:47:49.378342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 650/1336] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:47:50.390750 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:50.391713 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:50.398646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:50.399136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:50.399971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:50.400524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:50.438766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-80dff8cc-96d1-4af0-911c-198f72467224 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052078 Aug 27 03:47:50.439360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 687/1337] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:51.452455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:51.453505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:51.460778 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:51.461164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:51.461956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:51.462454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:51.494792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2020c6e6-2df9-4bbe-b4f6-82a5b9017723 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046617 Aug 27 03:47:51.498568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 651/1338] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:52.324187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:47:52.324460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:47:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:47:52.510262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:52.511869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:52.522521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:52.523254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:52.524623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:52.525373 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:52.575213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-822f8e37-e15f-4c2f-9424-d3956128cc0f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067825 Aug 27 03:47:52.575213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 688/1339] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:53.585515 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:53.586946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:53.593894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:53.594392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:53.595236 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:53.595698 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:53.627816 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c6fc3190-cb55-4cc1-947e-80e3d632dc2a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048806 Aug 27 03:47:53.628566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 652/1340] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:53 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:54.641201 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:54.642337 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:54.651973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:54.652407 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:54.653182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:54.653604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:54.692057 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-65fe4232-a458-4461-9a7a-fd09fb1f0a90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055745 Aug 27 03:47:54.693273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 689/1341] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:55.704050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:55.704969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:55.711242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:55.711689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:55.712479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:55.712912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:55.745715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-06c01426-022a-44cb-b37e-ac58c09d0ecd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Aug 27 03:47:55.749597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 653/1342] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:47:56.759039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:56.759039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:56.765376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:56.765915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:56.766733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:56.767309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:56.807467 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7d86c12e-275e-4fe1-8729-e7b9cc4c36f4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054255 Aug 27 03:47:56.808394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 690/1343] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:57.819959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:57.820801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:57.827298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:57.827754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:57.828532 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:57.829060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:57.862572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a1da43f4-8691-4ad0-80b9-4bfcc76298b0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047697 Aug 27 03:47:57.866878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 654/1344] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:58.874863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:58.875695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:58.882863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:58.883303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:58.884140 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:58.884573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:58.918186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74cb44b0-7267-4179-b91f-48f3f5b249c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046682 Aug 27 03:47:58.918927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 691/1345] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:59.930623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:59.931523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:47:59.937363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:59.937805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:59.938594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:59.939075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:59.972025 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d0dfed6f-40e4-4422-b871-badb9f678db8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046015 Aug 27 03:47:59.972596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 655/1346] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:47:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:00.984668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:00.985617 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:00.992763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:00.993207 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:00.994048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:00.996237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:01.029774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f1c3a641-39be-4aef-9e79-dfd091988628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049033 Aug 27 03:48:01.030439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 692/1347] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:00 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:02.042323 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:02.043242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:02.049188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:02.049640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:02.050504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:02.050980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:02.084922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1bfac214-ba49-4802-a52f-e973dc7c10b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Aug 27 03:48:02.085540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 656/1348] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:03.096604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:03.097552 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:03.105331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:03.105779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:03.106683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:03.107121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:03.139709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-adc6c81e-d9d5-471c-9438-9d610d4e93ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Aug 27 03:48:03.140332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 693/1349] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:04.152571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:04.153457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:04.162580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:04.163129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:04.163959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:04.164515 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:04.197521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c302b7e9-54de-4c3e-b6f5-f13d4bf049db tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048922 Aug 27 03:48:04.198121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 657/1350] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:04 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:05.211717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:05.212693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:05.218967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:05.219413 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:05.220202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:05.220640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:05.253432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bc87728e-ea2a-43b1-9948-7d13224ec946 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046983 Aug 27 03:48:05.254007 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 694/1351] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:06.265167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:06.266246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:06.272397 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:06.272837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:06.273596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:06.274041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:06.304427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-45b9b3e1-cdca-4eab-bf1a-676cd0012d78 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Aug 27 03:48:06.305261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 658/1352] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:07.316389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:07.317593 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:07.323420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:07.323857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:07.324611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:07.325039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:07.354247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3f261a59-96dd-4612-bd4d-089705fc9b76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041557 Aug 27 03:48:07.354807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 695/1353] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:08.308509 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:48:08.308748 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:48:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:48:08.365269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:08.366221 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:08.371983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:08.372419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:08.373169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:08.373597 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:08.403600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a615e7f9-3d33-4003-bf2b-c562f547061d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042612 Aug 27 03:48:08.404167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 659/1354] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:09.415328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:09.416262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:09.422168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:09.422608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:09.423358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:09.423781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:09.453426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a2bb1f2a-0819-4946-8cc2-06189576a4c3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 Aug 27 03:48:09.453980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 696/1355] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:10.464189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:10.465095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:10.471149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:10.471604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:10.472378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:10.473326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:10.504087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fa08031e-6ffa-49fc-a02d-27ae5814de32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Aug 27 03:48:10.504792 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 660/1356] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:11.515597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:11.516540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:11.523174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:11.523893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:11.524402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:11.524835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:11.555509 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9c276a38-decf-410e-a987-06f50e265061 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Aug 27 03:48:11.557696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 697/1357] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:12.567598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:12.568692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:12.575031 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:12.575506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:12.576268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:12.576784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:12.608822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c339edf0-7b36-4bd9-982b-5f045a843152 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Aug 27 03:48:12.609383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 661/1358] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:13.616207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:48:13.616888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:48:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:48:13.619864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:13.620784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:13.626822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:13.627279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:13.628059 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:13.628497 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:13.658094 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2fe1037c-3d32-46fc-b513-7764a148ea20 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Aug 27 03:48:13.658650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 698/1359] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:13 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:14.669824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:14.670752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:14.677425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:14.677875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:14.678640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:14.679068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:14.707203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ddb58e58-583b-454b-bf33-c76bcf42c6a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 Aug 27 03:48:14.707753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 662/1360] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:15.718625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:15.719548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:15.725872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:15.726344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:15.727103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:15.727530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:15.756775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9c647698-ed9f-4b22-b15b-795c7cbe1528 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 Aug 27 03:48:15.757317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 699/1361] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:16.768315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:16.769225 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:16.776301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:16.776750 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:16.777523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:16.777957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:16.809420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9237a42f-56b6-42fc-b85d-99ea05c18014 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Aug 27 03:48:16.809886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 663/1362] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:16.879568 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:16.880400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:16.886678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:16.887330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:16.888098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:16.888527 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:16.902680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] HTTP exception thrown: Instance c750bdb9-76a6-4631-89d9-78c4128f6c67 could not be found. Aug 27 03:48:16.903266 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Returning 404 to user: Instance c750bdb9-76a6-4631-89d9-78c4128f6c67 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:48:16.904097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-628dfd65-de20-42ea-a880-17cdc78b5fff tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 404 len: 111 microversion: 2.1 time: 0.028822 Aug 27 03:48:16.904628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 700/1363] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:48:16 2021] DELETE /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:48:16.912553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:16.913151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: c750bdb9-76a6-4631-89d9-78c4128f6c67] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:16.919324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:16.919771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:16.920543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:16.920976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:16.935174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] HTTP exception thrown: Instance c750bdb9-76a6-4631-89d9-78c4128f6c67 could not be found. Aug 27 03:48:16.935762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Returning 404 to user: Instance c750bdb9-76a6-4631-89d9-78c4128f6c67 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:48:16.936634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-842cf529-e885-427d-bdd0-e37bddc12608 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67" status: 404 len: 111 microversion: 2.1 time: 0.027863 Aug 27 03:48:16.937165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 664/1364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:16 2021] GET /compute/v2.1/servers/c750bdb9-76a6-4631-89d9-78c4128f6c67 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:48:17.821112 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:17.821948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:17.827907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:17.828355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:17.829134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:17.829565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:17.860054 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9d5c5155-9f10-4aa4-a8a1-cd4dce0b90ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Aug 27 03:48:17.860618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 701/1365] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:18.872522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:18.873418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:18.880843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:18.881286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:18.882156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:18.882599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:18.915735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1d0701b9-181b-466e-84f1-fad9239d1579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Aug 27 03:48:18.916333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 665/1366] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:19.928727 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:19.929580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:19.936176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:19.936635 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:19.937444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:19.937935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:19.971033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b1995ee9-4da4-426a-b6e4-c3af6ce56d8c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Aug 27 03:48:19.971610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 702/1367] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:20.983272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:20.984364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:20.999618 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:21.000069 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:21.000906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:21.001349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:21.037483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ca8f8396-0df9-4469-8016-3bced090e713 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058065 Aug 27 03:48:21.038123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 666/1368] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:22.053728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:22.056401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:22.065365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:22.066052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:22.067967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:22.068536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:22.102907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-18778f23-ff24-4b0c-83c8-890e2b4ed869 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056501 Aug 27 03:48:22.103534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 703/1369] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:23.115208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:23.116119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:23.122379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:23.122832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:23.123620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:23.124055 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:23.164988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-68900805-1d25-49f5-9085-1011ee1cbc11 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053974 Aug 27 03:48:23.165578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 667/1370] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:24.177053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:24.177873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:24.184614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:24.185199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:24.186179 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:24.186703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:24.225648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-725c3c08-e1cd-4c25-9622-f1847cfda6ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052513 Aug 27 03:48:24.226333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 704/1371] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:25.237256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:25.238558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:25.245283 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:25.245751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:25.246711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:25.247149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:25.282192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-02c42aff-1a7f-4a96-bbe2-5d7e75507f35 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049132 Aug 27 03:48:25.282800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 668/1372] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:26.294609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:26.295525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:26.302684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:26.303140 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:26.303918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:26.304354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:26.337699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-33410169-da22-46c4-a398-01c0bae00e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Aug 27 03:48:26.338352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 705/1373] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:27.351601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:27.352530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:27.358683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:27.359131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:27.359910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:27.360369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:27.392288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-841e9c10-7bf3-4875-b2d9-45ed93ff44b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Aug 27 03:48:27.392759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 669/1374] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:28.404399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:28.405501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:28.412158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:28.412640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:28.413453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:28.413920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:28.448387 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f8a39eb1-d03e-4e03-86a0-425a7b26320e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Aug 27 03:48:28.448967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 706/1375] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:29.460836 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:29.461759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:29.467772 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:29.468144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:29.468923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:29.469356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:29.500204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d87df35d-3273-4568-9a0a-a9b689e6af8e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Aug 27 03:48:29.500760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 670/1376] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:30.512824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:30.513651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:30.520823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:30.521306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:30.522127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:30.522595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:30.552522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f3d900d1-1bb0-481d-a6fe-dd5b90339178 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Aug 27 03:48:30.553088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 707/1377] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:31.564136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:31.565051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:31.573714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:31.574269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:31.575057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:31.575494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:31.608265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-90506d5f-73cc-4e37-81aa-b7367e20e8b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047794 Aug 27 03:48:31.608875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 671/1378] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:32.619981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:32.620977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:32.627009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:32.627456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:32.628228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:32.629838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:32.662851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-172c34fc-45d2-4ae2-8dd1-bb9e3ee708eb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Aug 27 03:48:32.667517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 708/1379] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:33.685631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:33.687083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:33.695717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:33.696154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:33.696926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:33.697351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:33.739379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d88a0bd9-478d-4ea6-91cc-285b4a18d944 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060025 Aug 27 03:48:33.740104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 672/1380] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:34.751664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:34.752579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:34.759464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:34.759905 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:34.760667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:34.761096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:34.791356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e7ecc48d-618e-4b80-89c5-d2cc6f25ce12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Aug 27 03:48:34.791925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 709/1381] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:35.802578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:35.803505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:35.813794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:35.814269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:35.815062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:35.815496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:35.846648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5db549cf-5274-49f8-a02a-92ee98144ca3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Aug 27 03:48:35.847246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 673/1382] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:36.858099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:36.859234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:36.865728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:36.866217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:36.866999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:36.867435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:36.897957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c9189ca5-1ce7-4c5c-8691-d4603fea3907 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Aug 27 03:48:36.898549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 710/1383] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:37.909967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:37.911104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:37.917282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:37.917732 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:37.918546 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:37.918980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:37.951534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6fba4724-229e-456c-be64-6f8966033d5d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Aug 27 03:48:37.951534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 674/1384] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:38.962878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:38.963802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:38.969743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:38.970258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:38.971056 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:38.971490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:39.001632 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a67eb067-acbb-4b90-846f-b5b828524962 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 Aug 27 03:48:39.002473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 711/1385] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:40.013659 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:40.014607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:40.021873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:40.022403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:40.023135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:40.023567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:40.055157 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e95226ea-68d9-4de0-bc72-2ee844d0698b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Aug 27 03:48:40.055727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 675/1386] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:41.067169 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:41.068079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:41.074161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:41.074618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:41.075383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:41.075813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:41.104735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a9a31889-6b4c-4e87-8475-ed47526c9b56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Aug 27 03:48:41.105283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 712/1387] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:42.116226 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:42.117162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:42.123100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:42.123539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:42.124299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:42.124729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:42.155359 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d215aed8-c3d8-4fa0-8097-4ae924327785 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042869 Aug 27 03:48:42.155922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 676/1388] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:43.167754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:43.168703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:43.174642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:43.176279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:43.177071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:43.177502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:43.207538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a5430141-d562-4f1f-a339-3eb277ce32df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Aug 27 03:48:43.208103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 713/1389] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:43 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:44.218218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:44.219069 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:44.225174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:44.225612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:44.226430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:44.226863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:44.256826 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b4208e72-f1bc-449b-8287-848ee51441e4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Aug 27 03:48:44.257383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 677/1390] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:45.268860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:45.269939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:45.276044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:45.276491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:45.277273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:45.277715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:45.307647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-07cb0a84-b79c-4e12-a0a1-360351ac00d6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 Aug 27 03:48:45.308226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 714/1391] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:46.319362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:46.320299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:46.326261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:46.326739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:46.327511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:46.327943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:46.357401 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d299785c-89a0-4217-a666-6b29e8affe21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 Aug 27 03:48:46.358000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 678/1392] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:47.369592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:47.370548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:47.376343 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:47.376783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:47.377537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:47.378702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:47.406885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-81374710-79f4-4927-b967-7a62e47d50b5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Aug 27 03:48:47.407431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 715/1393] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:48.418459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:48.419369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:48.426294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:48.426751 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:48.427524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:48.427955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:48.457902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-db646e81-5e21-4681-90cd-a4e583b07410 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 Aug 27 03:48:48.458505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 679/1394] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:49.469349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:49.470293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:49.476643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:49.477085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:49.477845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:49.478299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:49.507001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2411fcf6-959b-4e77-8069-bb7b029f3937 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Aug 27 03:48:49.507544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 716/1395] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:50.517559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:50.518553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:50.525123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:50.525566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:50.526366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:50.526802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:50.557920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-61d86f92-6ef6-4ccc-967f-e9f89fd249a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Aug 27 03:48:50.558388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 680/1396] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:51.568801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:51.569728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:51.575692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:51.576110 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:51.576875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:51.577303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:51.606375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-68c47524-2360-40c0-ba86-607d73867347 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041304 Aug 27 03:48:51.606936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 717/1397] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:52.618513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:52.619445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:52.625269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:52.625708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:52.626481 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:52.626925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:52.657566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-520d9410-5452-4933-ada0-e4f1d4baa30a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Aug 27 03:48:52.658126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 681/1398] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:53.669069 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:53.669983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:53.676606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:53.677060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:53.677828 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:53.678293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:53.707980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-437fa047-222b-4689-aea7-3ff93e0eaccb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042587 Aug 27 03:48:53.708530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 718/1399] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:53 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:54.719342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:54.720246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:54.726761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:54.727200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:54.727964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:54.728394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:54.757380 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b8ca1c1d-7ed3-4de0-a231-a268076d4821 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041919 Aug 27 03:48:54.757931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 682/1400] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:55.769213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:55.770153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:55.776557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:55.777005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:55.777770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:55.778230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:55.807605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8d36e77d-3bd7-46d8-9a65-bd5243eced69 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Aug 27 03:48:55.808078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 719/1401] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:56.819477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:56.820299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:56.826302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:56.826752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:56.827516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:56.827950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:56.859742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8b516817-0bc5-4862-9274-af8deb3f84a9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Aug 27 03:48:56.860310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 683/1402] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:57.871753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:57.872651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:57.879244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:57.879691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:57.880500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:57.880936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:57.915146 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f8a88335-ebcf-45d9-8453-22e317a7bcc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047353 Aug 27 03:48:57.915751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 720/1403] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:58.927654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:58.928479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:58.934863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:58.935309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:58.936079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:58.936511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:58.965987 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f9ddc514-2d06-4999-8996-7182d5e18923 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Aug 27 03:48:58.966572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 684/1404] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:59.977483 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:59.978458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:59.984213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:59.984651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:59.985399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:59.985831 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:00.015902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0a0156c3-286f-4886-b9e5-f1e45ba51f82 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Aug 27 03:49:00.016448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 721/1405] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:48:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:01.027869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:01.028782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:01.035588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:01.036053 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:01.036813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:01.037237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:01.066469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c1b3976c-85fd-450f-8f83-d98a45f57b10 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Aug 27 03:49:01.067013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 685/1406] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:02.078092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:02.079038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:02.085586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:02.086052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:02.086834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:02.087271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:02.117935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cba41d58-c485-49ae-95e9-342d97c4cecb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Aug 27 03:49:02.118542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 722/1407] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:03.129487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:03.130460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:03.136462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:03.136906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:03.137834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:03.138382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:03.168202 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-128572fa-63e1-471b-8548-413b11c60b88 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042558 Aug 27 03:49:03.168761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 686/1408] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:04.181553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:04.182550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:04.188553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:04.189001 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:04.189782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:04.190250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:04.220465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-46f5e1a1-00fe-4fe3-9b98-39ca3479e067 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Aug 27 03:49:04.221015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 723/1409] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:04 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:05.232068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:05.232990 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:05.238921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:05.239366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:05.240136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:05.240569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:05.269546 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-86f54510-bde3-4e73-b22c-a0f318b24355 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040710 Aug 27 03:49:05.270126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 687/1410] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:06.280907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:06.281825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:06.288869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:06.289314 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:06.290104 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:06.290543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:06.320331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-870160a9-9071-4ed1-819d-ac8cc7e01a13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 Aug 27 03:49:06.320881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 724/1411] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:07.332312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:07.333251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:07.339251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:07.339700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:07.340465 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:07.340902 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:07.372694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d2b5f75c-bf42-4530-89a8-5b531284b627 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Aug 27 03:49:07.373253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 688/1412] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:08.384761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:08.385673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:08.391793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:08.392246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:08.393027 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:08.393464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:08.423654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b5b78b81-c015-4d1d-9c6f-f356c016acdd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Aug 27 03:49:08.424206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 725/1413] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:09.435674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:09.436580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:09.443449 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:09.443895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:09.444666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:09.445097 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:09.480994 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fc7012be-5ffe-4f29-a86e-88958f1c8bf6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Aug 27 03:49:09.482029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 689/1414] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:10.493003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:10.493955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:10.499946 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:10.500384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:10.501144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:10.501721 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:10.531579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-81095d9b-50ed-43b2-9c06-2969217709fa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Aug 27 03:49:10.532129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 726/1415] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:11.545284 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:11.546739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:11.553703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:11.554432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:11.556674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:11.557371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:11.589281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2f382b82-698f-4a0e-8e4c-038dfa73f924 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049256 Aug 27 03:49:11.589858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 690/1416] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:12.601372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:12.602311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:12.608148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:12.608615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:12.609354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:12.609805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:12.642811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-589c07be-7079-4b10-b33f-86a88040dcb6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Aug 27 03:49:12.643394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 727/1417] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:13.654977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:13.655910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:13.662450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:13.662892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:13.663688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:13.664115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:13.694620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-45ec9857-60f8-4ad0-a3d4-e92da5f15646 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Aug 27 03:49:13.695194 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 691/1418] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:13 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:14.706829 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:14.708137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:14.714477 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:14.714921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:14.715707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:14.716142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:14.748267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5117362e-110d-4dfd-9da5-dda813faa8a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045701 Aug 27 03:49:14.748847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 728/1419] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:15.760320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:15.761241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:15.767342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:15.767790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:15.769018 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:15.769510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:15.802626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3d80309e-ec1f-4fcb-b80c-296e98379ea9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Aug 27 03:49:15.803204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 692/1420] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:16.815029 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:16.816679 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:16.822929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:16.823378 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:16.824163 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:16.824602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:16.856788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f15e5166-68ee-4c24-8810-248a5ff31932 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Aug 27 03:49:16.857709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 729/1421] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:17.869469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:17.870307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:17.876904 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:17.877346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:17.878225 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:17.878676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:17.914438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4c438bc0-480a-46f8-a7e3-6cc321b734ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048701 Aug 27 03:49:17.915003 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 693/1422] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:18.929949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:18.930871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:18.937717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:18.938253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:18.939078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:18.939551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:18.973569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ffdb0bce-7a22-43e9-945f-c46f543b42d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Aug 27 03:49:18.974178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 730/1423] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:19.984697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:19.985610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:19.992291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:19.992789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:19.993678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:19.994201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:20.029613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a88b441f-37ad-41d4-bae6-16dbba65b39c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Aug 27 03:49:20.030382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 694/1424] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:21.041613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:21.042582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:21.048574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:21.049023 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:21.050623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:21.051058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:21.080043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dad57e70-29d7-42ec-9558-e290f2df6824 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Aug 27 03:49:21.080598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 731/1425] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:22.091004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:22.091946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:22.099119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:22.099562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:22.100339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:22.100770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:22.132647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a8d59c62-e035-4439-9568-8ac20e8fbab0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Aug 27 03:49:22.133237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 695/1426] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:23.146184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:23.147136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:23.157686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:23.158185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:23.158970 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:23.159577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:23.192724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2a5f9093-af46-4b9c-b283-c3b38565bf30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052062 Aug 27 03:49:23.193307 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 732/1427] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:24.204566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:24.205473 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:24.211446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:24.211883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:24.212642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:24.213075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:24.242927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6228f3b3-dcde-4758-aedd-448e04556efe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042286 Aug 27 03:49:24.243486 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 696/1428] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:25.254494 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:25.255412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:25.261469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:25.261717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:25.262518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:25.262954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:25.295780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-094ede50-efa3-4e37-9b6d-23ce9ba006a0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045938 Aug 27 03:49:25.296339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 733/1429] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:26.307644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:26.308541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:26.314429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:26.314872 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:26.315638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:26.316067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:26.344371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6e42dcfc-a054-4b56-9d2d-47d39977da4b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Aug 27 03:49:26.344934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 697/1430] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:27.356369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:27.357278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:27.363263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:27.363701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:27.364450 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:27.364873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:27.393907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fab6989d-df3f-402c-ae66-a878b6b6412b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040681 Aug 27 03:49:27.394758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 734/1431] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:28.405680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:28.406627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:28.412839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:28.413285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:28.414107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:28.414541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:28.445129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-458c36d0-187e-44e0-8f0f-ab460ee431f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 Aug 27 03:49:28.445690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 698/1432] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:29.457227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:29.458205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:29.464172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:29.464622 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:29.465402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:29.465842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:29.498549 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0818d3c2-a344-4916-bd4a-2a7d7c0d5d3f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Aug 27 03:49:29.499123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 735/1433] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:29.651814 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:29.652405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:49:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:49:30.509952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:30.510905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:30.516966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:30.517413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:30.518378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:30.519425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:30.551062 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6095a5cf-6667-4581-9dc9-155dd87e56f6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Aug 27 03:49:30.551635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 699/1434] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:31.562816 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:31.563741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:31.570238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:31.570739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:31.571574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:31.572057 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:31.602827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e7739c56-2f3b-4daa-b4e9-247a87361893 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Aug 27 03:49:31.603396 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 736/1435] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:32.615516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:32.616425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:32.622295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:32.622739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:32.623500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:32.623932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:32.653463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-055ddda8-fe1a-4ba5-abcd-752299cc4b2d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042693 Aug 27 03:49:32.654341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 700/1436] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:33.667067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:33.668032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:33.675242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:33.675678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:33.676449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:33.676877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:33.714352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b317c505-1b23-4d76-92bf-1c3acb6aaac5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051765 Aug 27 03:49:33.714933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 737/1437] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:34.730851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:34.732504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:34.741399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:34.741877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:34.742703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:34.743140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:34.778712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fba86f9e-3fb8-4fcf-8cbe-b21cf2ecb44a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055176 Aug 27 03:49:34.779298 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 701/1438] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:35.791734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:35.792720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:35.799508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:35.799946 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:35.800722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:35.801151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:35.833154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7d41e079-c463-4a7b-b6db-bdd2e29d7b1d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Aug 27 03:49:35.833642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 738/1439] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:36.845114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:36.846544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:36.852938 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:36.853382 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:36.854233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:36.854666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:36.885779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9c5577a8-b0f8-44be-99d4-00cd465129ca tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Aug 27 03:49:36.886381 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 702/1440] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:37.897736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:37.898634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:37.904906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:37.905344 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:37.906157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:37.906589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:37.938884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0637dbf8-46aa-4ef4-827f-e41ec1322dc6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Aug 27 03:49:37.939453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 739/1441] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:38.951984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:38.952805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:38.959675 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:38.960128 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:38.960919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:38.961352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:38.996474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-00d9bc67-e08d-49eb-b66e-040dd705f8e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048285 Aug 27 03:49:38.997148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 703/1442] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:40.007927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:40.008864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:40.014988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:40.015438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:40.016221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:40.016658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:40.047684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-56750ffa-bd97-4c62-822c-14e8b27246d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Aug 27 03:49:40.048261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 740/1443] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:41.060566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:41.061526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:41.068186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:41.068625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:41.069391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:41.069815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:41.098769 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-663dd5a7-3016-4090-8e88-cfa2580b1a95 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Aug 27 03:49:41.099325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 704/1444] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:42.110312 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:42.111249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:42.118105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:42.118556 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:42.119346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:42.119782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:42.151397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-09f5655b-44e8-455a-9776-1ccbe6b6f686 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Aug 27 03:49:42.151948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 741/1445] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:43.163586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:43.164580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:43.171233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:43.171678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:43.172462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:43.172900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:43.206064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-20faf02a-c9de-4c81-bf7f-d8053a44abc8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046375 Aug 27 03:49:43.206829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 705/1446] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:43 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:44.217968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:44.218814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:44.224966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:44.225431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:44.226304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:44.226740 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:44.257809 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0509c165-36b9-430d-9d7d-5d61800f870a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Aug 27 03:49:44.258544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 742/1447] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:45.269378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:45.270334 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:45.276184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:45.276629 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:45.277402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:45.277825 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:45.309436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bcc38ade-a06e-4ce2-afa6-2fb8fda222a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Aug 27 03:49:45.310006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 706/1448] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:46.321988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:46.322846 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:46.328964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:46.329412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:46.330867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:46.331358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:46.363250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-00e0a338-cd3b-466d-9167-5d06621c827d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Aug 27 03:49:46.363830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 743/1449] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:47.375183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:47.376121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:47.382631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:47.383082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:47.383858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:47.384291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:47.414116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-62595bce-558d-41d1-bfa3-f6fad03ff4a4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Aug 27 03:49:47.414674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 707/1450] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:48.426840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:48.427755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:48.433883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:48.434354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:48.435124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:48.435554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:48.465950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-617b64ad-dd79-4fa8-88c4-7aaef5c8b673 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Aug 27 03:49:48.466460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 744/1451] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:49.477787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:49.478670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:49.484715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:49.485154 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:49.485957 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:49.486994 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:49.517120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-58774525-cd1b-496c-8a87-58c23a63a757 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Aug 27 03:49:49.517900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 708/1452] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:50.528881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:50.529711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:50.535720 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:50.536165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:50.536934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:50.537361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:50.568049 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2eefbe16-a77d-4879-ab95-a9485d74791b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 Aug 27 03:49:50.568609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 745/1453] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:51.579389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:51.581032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:51.587223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:51.587674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:51.588451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:51.588890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:51.620121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9d361dbd-8daa-4bba-aff0-52a6d90dad73 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Aug 27 03:49:51.620682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 709/1454] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:52.631648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:52.632613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:52.638538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:52.638983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:52.639755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:52.640191 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:52.672011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-46cbb947-fa16-46d0-ab0a-07f9de3e02c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Aug 27 03:49:52.672579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 746/1455] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:53.685086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:53.685918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:53.692462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:53.692895 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:53.693666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:53.694124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:53.726849 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-34c3e0fe-9249-402c-a0eb-1bbb28956e66 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Aug 27 03:49:53.727426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 710/1456] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:53 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:54.739140 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:54.740405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:54.746618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:54.747056 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:54.747826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:54.748250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:54.780187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f5a37132-f252-4466-87a3-9563ea297b02 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Aug 27 03:49:54.780747 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 747/1457] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:55.792146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:55.793352 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:55.800483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:55.800938 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:55.801723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:55.802200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:55.833685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8475309e-6517-4783-8842-158f3a364b53 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Aug 27 03:49:55.834207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 711/1458] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:56.250847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:56.251381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:49:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:49:56.845389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:56.846979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:56.853329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:56.853756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:56.854579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:56.855031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:56.888075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-44817842-79d4-4afe-b71c-f907960f41c8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046842 Aug 27 03:49:56.888651 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 748/1459] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:57.899693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:57.900551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:57.906396 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:57.906843 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:57.907603 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:57.908477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:57.937924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-18cd17b9-c9d3-4506-8619-9bab0ff64dac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042049 Aug 27 03:49:57.938510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 712/1460] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:58.950303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:58.951212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:49:58.957677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:58.958147 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:58.958907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:49:58.959328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:49:58.989444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-91488e8a-45df-4568-8892-f58e71565ea0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043039 Aug 27 03:49:58.990003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 749/1461] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:00.002455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:00.003520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:00.009863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:00.010345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:00.011125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:00.011558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:00.042996 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e255726f-3da3-4ff2-90f3-f21ba5505e7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Aug 27 03:50:00.043568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 713/1462] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:49:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:01.056029 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:01.056964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:01.063871 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:01.064361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:01.065156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:01.065621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:01.098993 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6f5eab8c-7fb3-4d4f-a6e9-b72706ffa92d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 Aug 27 03:50:01.099580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 750/1463] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:02.110652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:02.112176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:02.118411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:02.118860 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:02.119626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:02.120056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:02.151116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-46e1e68f-c0c5-4a1a-8e61-775ceeea7742 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Aug 27 03:50:02.151678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 714/1464] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:03.163585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:03.164496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:03.170497 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:03.170946 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:03.171722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:03.172177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:03.202944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-58b04511-89f9-4036-8190-0799163d4c18 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Aug 27 03:50:03.203500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 751/1465] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:04.214705 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:04.215715 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:04.222819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:04.223269 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:04.224061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:04.224498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:04.256379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-39bf18ae-4f61-44f6-9faf-fba41bfc4141 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Aug 27 03:50:04.256960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 715/1466] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:04 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:05.267832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:05.268775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:05.274817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:05.275282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:05.276046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:05.276480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:05.309550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-053310a1-216f-4f54-8ab8-40d77fdd7c4f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Aug 27 03:50:05.310734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 752/1467] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:06.321349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:06.322230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:06.328317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:06.328762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:06.330155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:06.330770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:06.360121 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-31e3a87e-250f-443f-913d-2c19ad09bc12 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 Aug 27 03:50:06.360687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 716/1468] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:07.371840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:07.372766 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:07.379758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:07.380206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:07.380997 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:07.381432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:07.412574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-de37a136-416f-483a-9d85-9a070d818ca6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Aug 27 03:50:07.413142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 753/1469] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:08.425479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:08.426450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:08.433407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:08.433917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:08.434883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:08.435454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:08.469278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e1c62f47-c305-4e56-abaa-66383ec98718 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048735 Aug 27 03:50:08.469862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 717/1470] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:09.484959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:09.486023 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:09.492739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:09.493183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:09.493981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:09.494446 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:09.527732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-19dfa7b6-6da5-4613-a5d4-89febaa8bedd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Aug 27 03:50:09.528478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 754/1471] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:10.539972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:10.540892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:10.546920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:10.547363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:10.548197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:10.548640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:10.591029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ff630cb6-7ee1-4561-8013-19844f81e3df tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054859 Aug 27 03:50:10.591908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 718/1472] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:11.603303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:11.604311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:11.612099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:11.612778 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:11.613642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:11.614178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:11.647949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6b2cb362-afda-4230-b340-7d99f551c6d2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048496 Aug 27 03:50:11.648619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 755/1473] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:12.660392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:12.661362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:12.668237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:12.668688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:12.669602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:12.670087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:12.704186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0ab51629-1e49-4c02-8ff2-bd2c3610f98e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047869 Aug 27 03:50:12.705243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 719/1474] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:13.716303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:13.717346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:13.724675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:13.725171 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:13.726070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:13.726744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:13.760231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a1ffdcd4-1a57-4f8d-8e86-ee36c8255fc0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Aug 27 03:50:13.760827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 756/1475] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:13 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:14.773052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:14.773960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:14.779910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:14.780351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:14.781115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:14.781550 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:14.812525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f12a620a-7c88-4e41-85dc-d037a275f4a6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Aug 27 03:50:14.813014 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 720/1476] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:15.825465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:15.826399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:15.832525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:15.832961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:15.833726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:15.834181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:15.863917 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bd1173a6-e004-43e0-9832-bb95bbf8a8c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042657 Aug 27 03:50:15.864472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 757/1477] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:16.876672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:16.877601 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:16.883598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:16.884042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:16.884832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:16.885267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:16.917140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dc746144-aa9d-41d8-8740-ec09d4794259 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Aug 27 03:50:16.917713 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 721/1478] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:17.930385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:17.931291 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:17.937113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:17.937555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:17.938347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:17.938820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:17.967958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3bf6c355-97c7-438d-9494-4f8f1be05422 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Aug 27 03:50:17.968512 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 758/1479] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:18.978981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:18.979892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:18.985875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:18.986320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:18.987100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:18.987530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:19.028223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-038e3e68-98b2-4757-8418-c978b273a3b9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052968 Aug 27 03:50:19.028785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 722/1480] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:20.043243 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:20.044158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:20.050602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:20.051094 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:20.051987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:20.052541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:20.088224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a06badb5-b1cf-426c-8fc4-6ae1bb0fe9ad tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048913 Aug 27 03:50:20.088913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 759/1481] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:21.101027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:21.101951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:21.108007 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:21.108451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:21.109227 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:21.109661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:21.141408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c41fc72d-1c1e-4f83-9bd5-4742ff0c2fe8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Aug 27 03:50:21.142253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 723/1482] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:22.153831 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:22.154830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:22.162868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:22.163319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:22.164114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:22.164550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:22.198426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-de8b6a40-264b-419e-877a-2198e0f0db4c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048562 Aug 27 03:50:22.199003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 760/1483] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:23.210331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:23.211268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:23.217767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:23.218245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:23.219041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:23.219476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:23.252361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7b5fbb03-792c-494e-981e-311a4514ead0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 27 03:50:23.252932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 724/1484] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:24.264207 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:24.265132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:24.267529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:50:24.271947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:24.272351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:24.273119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:24.273554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:24.315469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fdb0e9fe-a517-4db7-b420-1f8936bb0035 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055005 Aug 27 03:50:24.316048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 761/1485] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:25.325168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:50:25.328668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:25.329920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:25.336479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:25.336971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:25.337793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:25.338324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:25.369775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d2a21833-f556-4df6-8d59-4982d29b5349 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Aug 27 03:50:25.370377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 725/1486] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:26.382444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:26.383374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:26.401657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.402129 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:26.402914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.403347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:26.408807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 49114. Aug 27 03:50:26.440906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c6d77e14-6f67-4349-981f-09b01f99b8c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062146 Aug 27 03:50:26.441410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 762/1487] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:27.452553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:27.453525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:27.473588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:27.473951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:27.474858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:27.475202 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:27.481177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 49122. Aug 27 03:50:27.506944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0b488264-bc2d-4082-9d81-ef9f2cceb4e1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058157 Aug 27 03:50:27.507510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 726/1488] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:28.519439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:28.520363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:28.526366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:28.526818 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:28.527591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:28.528020 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:28.564322 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9095f31e-2436-4799-81e1-bab58cccf0e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048798 Aug 27 03:50:28.564918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 763/1489] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:29.576052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:29.576963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:29.583445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:29.583903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:29.584660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:29.585087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:29.615212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d64c4417-dfa7-46c3-a0ed-8c8681bf0218 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Aug 27 03:50:29.615790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 727/1490] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:30.627109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:30.628028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:30.634066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:30.634512 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:30.635288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:30.635717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:30.669309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-05e41311-c0ed-4884-95b1-36eefd65509a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046138 Aug 27 03:50:30.669876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 764/1491] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:31.681365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:31.682246 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:31.689445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:31.689912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:31.690724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:31.691156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:31.724201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3d0ec3cd-9b65-4cc7-bc07-386e01a7efc9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 Aug 27 03:50:31.724787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 728/1492] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:32.736539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:32.737457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:32.743393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:32.743828 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:32.744590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:32.745015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:32.776753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fbbd81f3-6139-4f1c-9e80-88075be0c8dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 27 03:50:32.777342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 765/1493] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:33.789752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:33.790684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:33.796509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.796945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:33.798487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.798923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:33.830700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-88ad5612-f85a-486b-bc07-6e8a968ba569 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Aug 27 03:50:33.831533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 729/1494] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:34.847073 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:34.848034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:34.854285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:34.854734 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:34.855523 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:34.855955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:34.891826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e09a1bf4-cdbd-4020-9d1f-5faffa0a4584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052001 Aug 27 03:50:34.892827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 766/1495] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:35.908158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:35.909262 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:35.916773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:35.917363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:35.918302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:35.918796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:35.963945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-abf13784-6d87-4994-82a5-95cc4c466ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061483 Aug 27 03:50:35.964860 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 730/1496] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:36.976600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:36.977528 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:36.983486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:36.983936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:36.984713 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:36.985749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.020081 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dc55043f-6032-4043-8abb-598df63e8187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Aug 27 03:50:37.020716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 767/1497] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:38.034990 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:38.036233 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:38.043641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:38.044240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:38.045243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:38.045822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:38.087004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1ff8a7f2-ccac-4a73-9b51-f16d7e0ec9f1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057424 Aug 27 03:50:38.087789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 731/1498] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:39.100267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:39.101194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:39.107168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:39.107615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:39.108389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:39.108822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:39.140781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-66d3337a-945e-4960-af29-c0ec9cd6a7ab tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Aug 27 03:50:39.141589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 768/1499] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:39 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:40.152929 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:40.153734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:40.159812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:40.160259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:40.161030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:40.161464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:40.193455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be1f9479-7a60-42ec-be28-0363a90ee76e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Aug 27 03:50:40.194057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 732/1500] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.205061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:41.205962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:41.212123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:41.212607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:41.213473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:41.213824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:41.244781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c316b059-9f4d-4bac-b23f-69a5b6e7a876 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Aug 27 03:50:41.245334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 769/1501] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:42.256646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:42.257558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:42.263534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:42.263978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:42.264745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:42.265176 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:42.296974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-362f7719-9c67-406b-803a-122df74138f2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Aug 27 03:50:42.297557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 733/1502] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:43.308880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:43.309800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:43.316275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:43.316723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:43.317506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:43.317935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:43.351162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-219c517f-4557-4e88-971a-5faca3ee3dc3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Aug 27 03:50:43.352080 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 770/1503] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:43 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:44.363626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:44.364456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:44.370535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:44.370982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:44.371764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:44.372197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:44.409129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7335dbdc-bfcb-4ba8-9ab2-c64b6fe046ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049770 Aug 27 03:50:44.409712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 734/1504] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:45.420842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:45.421870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:45.429466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:45.429915 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:45.430732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:45.431170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:45.464087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a21da9be-e584-4714-affd-8f7e282a5037 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046995 Aug 27 03:50:45.464656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 771/1505] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:46.476449 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:46.477401 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:46.483709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:46.484150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:46.486051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:46.486921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:46.519021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-262c00f7-3a8a-4002-ad76-1970e54a8ff8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046311 Aug 27 03:50:46.519620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 735/1506] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:47.530827 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:47.532546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:47.538626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:47.539075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:47.539857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:47.540293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:47.574612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-03aedd51-2d84-4986-afcc-0d1b7a8c23c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047480 Aug 27 03:50:47.575202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 772/1507] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:48.586044 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:48.587359 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:48.593346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:48.593899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:48.595208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:48.595629 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:48.634214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-eb5c227e-bbbf-4faf-8e8a-c46b1604d040 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051746 Aug 27 03:50:48.635288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 736/1508] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:49.647544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:49.648459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:49.654386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:49.654834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:49.655636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:49.656076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:49.687162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-389a6b00-017f-4ee8-a103-2f1043ae9efc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Aug 27 03:50:49.687739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 773/1509] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:50.699948 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:50.700876 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:50.707256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:50.707696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:50.708452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:50.708881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:50.738623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fdd7fe1c-0235-4c79-a6bb-1a02d93c9791 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Aug 27 03:50:50.739177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 737/1510] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:51.751083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:51.752409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:51.758363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:51.758815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:51.759591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:51.760025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:51.790433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f85d50a3-6145-4b43-b776-e1b5b6285c04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Aug 27 03:50:51.790984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 774/1511] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:52.802037 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:52.803216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:52.809017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:52.809459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:52.810315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:52.810815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:52.843420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d211b5bf-f46d-40f1-b6d9-519fdf0c6c6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Aug 27 03:50:52.844020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 738/1512] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:53.856365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:53.857329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:53.864226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:53.864668 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:53.865448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:53.865877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:53.895488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ba0d0a74-ca09-44e0-a11c-2acb4be59e04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 Aug 27 03:50:53.896346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 775/1513] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:53 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:54.908704 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:54.909610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:54.915452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:54.915894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:54.916651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:54.917074 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:54.949691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6b56d4b9-1092-4b6c-8e8c-ed5486988b96 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Aug 27 03:50:54.950288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 739/1514] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:55.961400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:55.962267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:55.968093 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:55.968531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:55.969331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:55.969755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:55.999645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2e26389f-7955-439c-bb9c-b3a13fd89da5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Aug 27 03:50:56.000968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 776/1515] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:57.011889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:57.012823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:57.019581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:57.020042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:57.020784 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:57.021207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:57.053472 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0abb3585-904e-4384-87c8-255c9176915c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 27 03:50:57.054060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 740/1516] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:58.065267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:58.066240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:58.072536 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:58.072980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:58.073780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:58.074240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:58.105039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-baac2225-06f8-456c-b0f5-d44b0b6bd2fb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Aug 27 03:50:58.105605 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 777/1517] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:59.116569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:59.117479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:59.123802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:59.124247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:59.125600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:59.126221 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:59.156112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-51af49fc-244d-4c10-badd-645e08d97021 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043246 Aug 27 03:50:59.156801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 741/1518] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:50:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:00.167821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:00.168729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:00.175106 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:00.177975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:00.179979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:00.180437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:00.209862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-86814f99-4c5f-48c6-ad1b-df096ed7e816 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045731 Aug 27 03:51:00.210461 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 778/1519] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:00 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:01.221264 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:01.222243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:01.228169 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:01.228615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:01.229385 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:01.229818 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:01.260542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5ef7c475-c2eb-4509-865c-d9f82a8f9a7f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Aug 27 03:51:01.261099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 742/1520] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:02.272116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:02.273119 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:02.279159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:02.279602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:02.280374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:02.280807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:02.312038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bf01c053-db32-4e03-8271-85969d6a3e17 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Aug 27 03:51:02.312659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 779/1521] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:03.323978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:03.324893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:03.331516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:03.331966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:03.332724 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:03.333153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:03.361728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-34163f96-8580-409e-bef3-17f624349649 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Aug 27 03:51:03.362310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 743/1522] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:04.373716 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:04.374660 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:04.381615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:04.382082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:04.382924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:04.383299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:04.414237 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-be0f13b6-cc12-4281-bb5d-69c9b2f1a1aa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Aug 27 03:51:04.414974 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 780/1523] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:04 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:05.425765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:05.426620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:05.432787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:05.433235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:05.434000 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:05.434473 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:05.465829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c927373f-aec8-47e3-9564-07897aaefc45 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Aug 27 03:51:05.466433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 744/1524] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:06.478026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:06.478996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:06.485594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:06.486068 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:06.486938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:06.487418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:06.517013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-689d55ec-bd57-49a6-8bee-b7451749ffe0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042807 Aug 27 03:51:06.517569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 781/1525] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:06.872143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:51:06.872418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:51:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:51:07.528484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:07.529417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:07.535456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:07.535878 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:07.536644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:07.537065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:07.573735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9ab3071c-4df1-4310-9a66-d08f96613326 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048932 Aug 27 03:51:07.574369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 745/1526] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:08.586328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:08.587185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:08.593093 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:08.594106 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:08.594839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:08.595263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:08.624953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a8fb6060-5790-4e15-9d6f-c410f5e5497e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Aug 27 03:51:08.625606 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 782/1527] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:09.637265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:09.638244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:09.644992 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:09.645437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:09.646279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:09.646721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:09.680863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e49b8c51-f7ee-4692-95a1-c897e5be1b26 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047655 Aug 27 03:51:09.681623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 746/1528] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:10.691648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:10.692572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:10.698762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:10.699208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:10.699975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:10.700400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:10.729823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5546f246-cd54-4931-a164-8e6d7b72ac39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 Aug 27 03:51:10.730390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 783/1529] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:11.741312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:11.742250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:11.748248 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:11.748699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:11.749511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:11.749975 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:11.779746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0c162f21-250b-46f4-9d78-3cb012a067ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042106 Aug 27 03:51:11.780223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 747/1530] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:12.342923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:51:12.343148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:51:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:51:12.791973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:12.792897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:12.798856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:12.799304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:12.800101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:12.800539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:12.830578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-78285381-438b-4ab7-afc1-b2396c336d13 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042376 Aug 27 03:51:12.831135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 784/1531] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:13.842077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:13.842995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:13.849544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:13.849988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:13.850782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:13.851213 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:13.880945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ca8613a4-e1f4-414a-9fb2-cf465ea7cd43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Aug 27 03:51:13.881495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 748/1532] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:13 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:14.892777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:14.893684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:14.899789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:14.900238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:14.901016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:14.901447 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:14.932519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-150f0e86-de17-4f2b-9119-18a05f2921c5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Aug 27 03:51:14.933084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 785/1533] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:15.944261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:15.945087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:15.950978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:15.951428 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:15.952198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:15.953275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:15.982197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-be838a3b-a7d5-4aa3-8826-f02c4647502d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 Aug 27 03:51:15.982748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 749/1534] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:16.994971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:16.995922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:17.003524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:17.003973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:17.004759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:17.005194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:17.047310 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0ad52fa8-f634-4790-a8eb-c9db331e3110 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055220 Aug 27 03:51:17.048190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 786/1535] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:18.059107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:18.060016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:18.066098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:18.066541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:18.067303 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:18.067731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:18.104200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e1a36a8e-1d1b-4ae4-85de-856493ca94d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048791 Aug 27 03:51:18.104781 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 750/1536] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:19.116053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:19.116957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:19.123100 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:19.123537 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:19.124407 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:19.124936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:19.154503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-70b02cae-918b-4471-bc9e-b7660dc5a65d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042143 Aug 27 03:51:19.155053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 787/1537] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:20.166777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:20.167690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:20.174494 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:20.174946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:20.175720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:20.176155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:20.206789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-753a44f4-0cd2-42c8-9f40-175ec25aaeac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043753 Aug 27 03:51:20.207350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 751/1538] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:21.218861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:21.220421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:21.229241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:21.229687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:21.230493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:21.230930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:21.260914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d1f0dd7-91ae-4d86-9f03-d601c2936bcb tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046431 Aug 27 03:51:21.261464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 788/1539] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:22.272335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:22.273232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:22.279082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:22.279522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:22.280276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:22.281678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:22.311183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ab504b1e-1df9-4565-a6c0-9be4cc7dd503 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042550 Aug 27 03:51:22.311930 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 752/1540] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:23.323592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:23.324284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:23.331417 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:23.331867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:23.332641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:23.333263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:23.362632 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3abe4aea-764b-416b-957c-5731becc9ca9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Aug 27 03:51:23.363181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 789/1541] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:24.375032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:24.375862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:24.381927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.382807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.383187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.383624 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.414495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a89e67a8-1e6a-404e-9528-c217b7b3fe5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Aug 27 03:51:24.415057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 753/1542] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:25.426620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:25.427843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:25.433805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:25.434388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:25.435034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:25.435474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:25.479099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a38288ad-eb41-4c8f-bae0-52d9bdb4b724 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056247 Aug 27 03:51:25.479694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 790/1543] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:26.490948 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:26.491971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:26.497721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:26.498201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:26.498961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:26.499911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:26.528828 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-59714279-3f57-4845-8573-169295402e3e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Aug 27 03:51:26.529377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 754/1544] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:27.540492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:27.541398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:27.547975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:27.548409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:27.549172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:27.549600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:27.580945 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-72bec070-9df9-485a-a4c4-525e3e6a20e3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Aug 27 03:51:27.581502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 791/1545] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:28.327341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:51:28.327619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:51:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:51:28.592620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:28.594829 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:28.599642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:28.600089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:28.600858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:28.601291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:28.630396 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c2ac152d-d2db-4765-b5da-9750901f5068 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041680 Aug 27 03:51:28.630947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 755/1546] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:29.642435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:29.643348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:29.649258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:29.649706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:29.650502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:29.650936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:29.682501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-03faef56-0230-4bef-b27b-94bb084707ce tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044961 Aug 27 03:51:29.683058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 792/1547] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:30.694378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:30.695326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:30.701184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:30.701632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:30.703529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:30.703972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:30.733206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7fc1d758-4f42-4e9a-a8eb-4291617c9799 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042594 Aug 27 03:51:30.734426 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 756/1548] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:31.744688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:31.745595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:31.752042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:31.752492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:31.753555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:31.753999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:31.785156 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b1aa20a1-832e-4b82-a06c-971a4daf0f8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 27 03:51:31.785725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 793/1549] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:32.797123 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:32.798114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:32.804350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:32.804867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:32.805576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:32.806028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:32.837700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-61c6aa9a-bebb-4971-9f18-51c4587c1376 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Aug 27 03:51:32.838540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 757/1550] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:33.634759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:51:33.635029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:51:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:51:33.849776 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:33.850715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:33.856570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:33.857016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:33.857805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:33.858916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:33.887199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8571c7df-2709-46b4-b9d1-2e7c1ec86daa tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Aug 27 03:51:33.887749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 794/1551] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:34.898641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:34.899554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:34.906119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:34.906582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:34.907361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:34.907799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:34.938411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8737da8b-1068-4a31-8047-405e5cb5fc7b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Aug 27 03:51:34.938980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 758/1552] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:35.950580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:35.951410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:35.957839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:35.958316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:35.959098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:35.959535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:35.992609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e19c94db-181a-4eb3-af82-c9075d9a7a76 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Aug 27 03:51:35.993179 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 795/1553] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:37.005268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:37.006145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:37.012334 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:37.012771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:37.013525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:37.013954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:37.043255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-bd0b0532-16e7-4f52-8ba9-8f3c208584ef tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 Aug 27 03:51:37.043805 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 759/1554] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:38.054877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:38.055800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:38.062658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:38.063111 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:38.063894 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:38.064321 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:38.093292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0cccd482-a68b-41d6-aeaf-dbbe25ddbea4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Aug 27 03:51:38.093806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 796/1555] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:39.104775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:39.105676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:39.112728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:39.113187 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:39.113958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:39.114416 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:39.143881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-51fdb21c-f563-46e2-a6f3-eb439a0a598d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Aug 27 03:51:39.144436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 760/1556] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:39 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:40.156074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:40.156985 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:40.162911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:40.163356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:40.164120 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:40.164551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:40.194286 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d1c413f-8e40-41f4-9fab-875fe2979fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Aug 27 03:51:40.194860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 797/1557] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:41.205782 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:41.206632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:41.212604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:41.213045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:41.213797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:41.214248 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:41.244422 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a8b5a072-643e-4122-a16f-012d263dbd7d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Aug 27 03:51:41.244967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 761/1558] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:42.255659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:42.256571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:42.262501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:42.262946 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:42.263714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:42.264143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:42.294650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9ac72351-f066-46cd-857f-b2a5dec185c6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Aug 27 03:51:42.295213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 798/1559] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:43.307314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:43.308260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:43.315467 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:43.315919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:43.316710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:43.317146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:43.353666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9c46f36f-e2bf-4300-9a99-224a3f1299d1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050182 Aug 27 03:51:43.354337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 762/1560] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:43 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:44.365354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:44.366301 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:44.372118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:44.372564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:44.373325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:44.373891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:44.403994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0c5ad3e3-144c-4b02-8eba-7df55322b23f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Aug 27 03:51:44.404543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 799/1561] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:45.415723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:45.416623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:45.423048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:45.423482 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:45.424230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:45.424651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:45.455002 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-38df8e2f-381a-4e80-a952-910c56a774ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043009 Aug 27 03:51:45.455571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 763/1562] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:46.466535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:46.467519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:46.473533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:46.473972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:46.474767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:46.475234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:46.506590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c1e6444a-7f58-49c6-b89f-b0197e75486e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Aug 27 03:51:46.507151 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 800/1563] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:47.518209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:47.519089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:47.525019 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:47.525463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:47.526252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:47.526681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:47.557420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1cf14379-082d-4a6f-9265-020075d98ab9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Aug 27 03:51:47.557991 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 764/1564] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:48.568675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:48.569596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:48.575499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:48.575944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:48.577220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:48.577647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:48.606662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f7607492-6b00-4bb7-8ae2-fd9ede2721fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 Aug 27 03:51:48.607215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 801/1565] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:49.618697 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:49.619608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:49.626110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:49.626559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:49.627325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:49.627756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:49.656920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-87a3dd76-7d2b-4cb4-8b36-df1d6e41e692 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Aug 27 03:51:49.657479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 765/1566] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:50.668669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:50.669593 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:50.676535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:50.677247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:50.678039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:50.678485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:50.710568 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d3c028db-7d0e-4978-856c-020f332826e7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Aug 27 03:51:50.711150 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 802/1567] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:51.722247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:51.723065 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:51.728933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:51.729373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:51.730181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:51.730607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:51.761337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9d958394-11f0-4962-975e-ee1cc1927f80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042875 Aug 27 03:51:51.761894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 766/1568] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:52.772793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:52.773704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:52.779773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:52.780887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:52.781675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:52.782134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:52.813411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d1140939-d629-43f9-b3d2-b44c763f3ca5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 27 03:51:52.814040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 803/1569] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:53.825244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:53.826179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:53.832314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:53.832756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:53.833516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:53.833953 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:53.863181 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aea4c123-ae06-4f26-8707-c3fb4835e42a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Aug 27 03:51:53.863738 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 767/1570] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:53 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:54.875164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:54.876082 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:54.881991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:54.882590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:54.883360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:54.883795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:54.915040 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fb108a7a-acc4-4e76-9a1e-6593d9e2e102 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Aug 27 03:51:54.915608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 804/1571] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:55.928693 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:55.929516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:55.935404 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:55.936555 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:55.937635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:55.938080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:55.966893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d3bf1033-073c-45b1-a301-370179b48855 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042364 Aug 27 03:51:55.967658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 768/1572] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:56.979057 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:56.979883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:56.987137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:56.987582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:56.988356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:56.988790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:57.019852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fbcde2a1-4bc7-43c8-ae66-32e050c5c71e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 Aug 27 03:51:57.020406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 805/1573] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:58.241088 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:58.242099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:58.248124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:58.248572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:58.249506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:58.249937 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:58.279600 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ae64c86f-0369-426c-94dc-c6e56eb1ade1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251969 Aug 27 03:51:58.280854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 769/1574] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:59.292470 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:59.293439 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:51:59.300729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:59.301198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:59.302687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:59.303123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:59.336345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-85d7ab3e-85b6-4dce-b9f4-09d17dabda6e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048218 Aug 27 03:51:59.336907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 806/1575] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:51:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:00.348906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:00.349736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:00.355594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:00.356041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:00.356802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:00.357235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:00.386913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4e6d2ea7-2632-4145-8add-377747542c5a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 Aug 27 03:52:00.387463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 770/1576] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:00 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:01.399211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:01.400108 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:01.405960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:01.406431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:01.407192 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:01.407662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:01.437762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0e87da3f-d680-4fb0-92cf-6714fab49a5b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042297 Aug 27 03:52:01.438339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 807/1577] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:02.451096 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:02.453198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:02.459783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:02.460230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:02.461005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:02.461440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:02.490700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8903a8f2-e817-4d35-aff0-5c2e9c7fe131 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Aug 27 03:52:02.491259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 771/1578] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:03.502594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:03.503522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:03.509813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:03.510293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:03.511143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:03.511577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:03.540726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-28e04f20-940b-498c-bca5-c145d96eef03 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042564 Aug 27 03:52:03.541287 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 808/1579] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:04.552682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:04.553599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:04.559665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:04.560116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:04.562050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:04.562497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:04.593328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-71d45970-5bca-4f14-8b53-f442e0c5bb1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Aug 27 03:52:04.593889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 772/1580] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:04 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:52:05.606979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:05.608171 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:05.614279 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:05.614729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:05.615499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:05.615935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:05.646585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3081f284-a235-40c8-a7cc-05c168fc56af tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Aug 27 03:52:05.647158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 809/1581] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:06.658740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:06.659652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:06.665485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:06.665931 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:06.666727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:06.667161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:06.697303 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e60c663b-4a90-421a-8caa-1e798a29b6fc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Aug 27 03:52:06.697876 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 773/1582] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:07.708761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:07.709663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:07.715580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:07.716017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:07.717317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:07.717784 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:07.746913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5cd57ae4-ed7b-4a84-9589-6c4b4f41e579 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Aug 27 03:52:07.747459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 810/1583] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:08.758493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:08.759434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:08.765644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:08.766119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:08.767305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:08.767743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:08.798388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-39842334-8319-420d-8484-3cd2bd004419 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Aug 27 03:52:08.798949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 774/1584] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:09.810225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:09.811580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:09.817395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:09.817842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:09.818636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:09.819078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:09.848013 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d1b0e965-27b5-46a8-bc6a-37b2ca3aa113 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Aug 27 03:52:09.848564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 811/1585] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:10.859812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:10.860633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:10.866489 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:10.866936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:10.867707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:10.868144 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:10.898141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ad9e1dfe-3122-4978-97b2-58abbe76715a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Aug 27 03:52:10.898695 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 775/1586] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:11.909571 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:11.910509 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:11.916427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:11.916868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:11.917620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:11.918066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:11.948235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d4396e89-6dea-440b-997d-0d1811ff23ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Aug 27 03:52:11.948783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 812/1587] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:12.960215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:12.961158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:12.967757 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:12.968280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:12.969051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:12.969488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:13.000566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-01571c95-87b9-4e6e-b212-4cbdee4110bf tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Aug 27 03:52:13.001427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 776/1588] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:14.012109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:14.013011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:14.019930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:14.020501 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:14.021400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:14.021836 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:14.053159 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a0d72f0d-df87-4d3e-b7f1-9c4211ac2be0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 27 03:52:14.053745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 813/1589] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:15.064776 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:15.065690 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:15.071443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:15.071962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:15.072793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:15.073225 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:15.105413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cae7e7e4-f5db-447a-8e55-745c66663f24 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Aug 27 03:52:15.105980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 777/1590] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:16.117949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:16.118885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:16.125498 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:16.125944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:16.126738 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:16.127170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:16.156853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fa66ff1b-4c7f-40be-993d-b623f83fff2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Aug 27 03:52:16.157401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 814/1591] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:17.168454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:17.169394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:17.175374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:17.175824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:17.176855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:17.177290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:17.206647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-af8cb138-0fad-4eae-95d8-4269635b4c8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 Aug 27 03:52:17.207209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 778/1592] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:18.219220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:18.220138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:18.226307 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:18.226755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:18.227525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:18.227953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:18.259074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2fe57a29-9681-4a76-81fe-636b2db604b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 27 03:52:18.259883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 815/1593] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:19.270566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:19.271510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:19.277407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:19.277847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:19.278646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:19.279242 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:19.309146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ac4fddd9-312c-40b7-a50e-50caa57942c4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Aug 27 03:52:19.309688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 779/1594] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:20.321541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:20.322473 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:20.328991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:20.329464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:20.330252 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:20.330685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:20.361448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-84b3d201-f23b-48cb-a5e6-4ffb498bd187 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Aug 27 03:52:20.362005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 816/1595] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:21.373502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:21.374429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:21.380335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:21.380786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:21.381548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:21.381984 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:21.412194 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4df7fc6a-cf23-4873-97b4-f6fb6fde1ff7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Aug 27 03:52:21.412961 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 780/1596] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:22.424394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:22.425299 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:22.431408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:22.431844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:22.432591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:22.433009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:22.462049 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-80d11265-36f6-4973-b132-776f4ba0026d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041355 Aug 27 03:52:22.462610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 817/1597] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:23.473508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:23.474464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:23.480876 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:23.481302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:23.482657 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:23.483092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:23.513185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9f3b7a2b-8832-4caa-80ca-861e94d8318e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Aug 27 03:52:23.513734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 781/1598] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:24.524718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:24.525656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:24.532336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:24.532788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:24.533519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:24.533942 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:24.562645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cc583cf0-8e1a-4da4-adf0-1ac3ab0b435e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Aug 27 03:52:24.563200 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 818/1599] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:25.574346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:25.575190 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:25.581234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:25.581672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:25.582488 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:25.582923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:25.613694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1cf8ae46-030c-48c8-ac69-7aca4521f99c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Aug 27 03:52:25.614293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 782/1600] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:26.628025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:26.628873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:26.634877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:26.635317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:26.636070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:26.636491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:26.666039 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b4a907c0-abea-4d0a-ab06-987ba8b41d1a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Aug 27 03:52:26.666584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 819/1601] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:27.678526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:27.679341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:27.685326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:27.685764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:27.686552 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:27.686971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:27.716084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dd1f7e8e-321b-46ed-b943-95c23bad7c70 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Aug 27 03:52:27.717374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 783/1602] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:28.728703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:28.729544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:28.735511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:28.735965 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:28.736725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:28.737155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:28.766584 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5c243813-7b9a-4ba9-89cb-8d7817635b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Aug 27 03:52:28.767128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 820/1603] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:29.778230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:29.779561 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:29.786365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:29.786825 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:29.787602 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:29.788039 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:29.818332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-627d29b1-d43b-4712-9a0c-086ff114bdcd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 27 03:52:29.818800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 784/1604] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:30.830800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:30.831730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:30.837765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:30.838250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:30.839139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:30.839759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:30.879260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7bc472be-0854-4140-93eb-7958e5bbea1e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052026 Aug 27 03:52:30.879881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 821/1605] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:31.428326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:31.428944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:31.436215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.436759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.437622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.438186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.463130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:52:31.496452 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-a1b67248-31e8-4f91-b355-32ebace030bc req-8ebe8d67-6072-43fc-a7de-830199f94caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a03aa5-2406-4897-ab82-ed8c62cdab4c", "tag": "c2519256-b76c-4991-bea8-ecb5807c4769"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:31.499566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:52:31.499566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 03:52:31.507131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-a1b67248-31e8-4f91-b355-32ebace030bc req-8ebe8d67-6072-43fc-a7de-830199f94caf service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.507583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-a1b67248-31e8-4f91-b355-32ebace030bc req-8ebe8d67-6072-43fc-a7de-830199f94caf service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.520807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-a1b67248-31e8-4f91-b355-32ebace030bc req-8ebe8d67-6072-43fc-a7de-830199f94caf service nova] Creating event network-changed:c2519256-b76c-4991-bea8-ecb5807c4769 for instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c on hv-cinder-77398 Aug 27 03:52:31.530729 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-a1b67248-31e8-4f91-b355-32ebace030bc req-8ebe8d67-6072-43fc-a7de-830199f94caf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103240 Aug 27 03:52:31.531451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 822/1606] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:31.543419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-907552f9-32ac-41ab-92e0-422ab0fe4530 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 204 len: 0 microversion: 2.1 time: 0.118818 Aug 27 03:52:31.544006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 785/1607] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:52:31 2021] DELETE /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:52:31.553756 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:31.554494 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:31.564813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.565280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.566117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.566555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.892532 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:31.893557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:31.899997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.900438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.901919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:31.901919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:31.937124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8591bdab-b244-4985-9247-6c1496e71f0a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049255 Aug 27 03:52:31.937716 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 786/1608] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:52:32.165023 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:32.173644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74bc615b-3784-4daf-8d5e-edbe2d806d4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1578 microversion: 2.1 time: 0.624424 Aug 27 03:52:32.174247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 823/1609] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:31 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1578 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:32.948737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:32.949652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:32.957222 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:32.957676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:32.958479 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:32.958916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:32.990745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-34dde438-b84d-4d68-9e3a-893c4bd59ee6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045759 Aug 27 03:52:32.991320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 787/1610] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:33.192281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:33.192893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:33.198796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:33.199261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:33.200011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:33.200576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:33.260788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:33.268389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ebbe3b82-8b23-476d-9c54-c12a784460cd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079759 Aug 27 03:52:33.268959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 824/1611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:33 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:33.546091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-c3283ce6-6545-4734-b2e0-3332bf25e79a req-996cd360-d955-4132-a132-8a70ef78d68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a03aa5-2406-4897-ab82-ed8c62cdab4c", "name": "network-vif-deleted", "tag": "c2519256-b76c-4991-bea8-ecb5807c4769"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:33.547630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:52:33.547630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:52:33.555539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c3283ce6-6545-4734-b2e0-3332bf25e79a req-996cd360-d955-4132-a132-8a70ef78d68a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:33.555975 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-c3283ce6-6545-4734-b2e0-3332bf25e79a req-996cd360-d955-4132-a132-8a70ef78d68a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:33.567434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-c3283ce6-6545-4734-b2e0-3332bf25e79a req-996cd360-d955-4132-a132-8a70ef78d68a service nova] Creating event network-vif-deleted:c2519256-b76c-4991-bea8-ecb5807c4769 for instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c on hv-cinder-77398 Aug 27 03:52:33.572761 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-c3283ce6-6545-4734-b2e0-3332bf25e79a req-996cd360-d955-4132-a132-8a70ef78d68a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Aug 27 03:52:33.573704 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 788/1612] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:52:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:34.005634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:34.007519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:34.017089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:34.017809 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:34.019022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:34.019765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:34.054430 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-59e9f3aa-b504-4fcc-b0d0-2e83d147d290 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055048 Aug 27 03:52:34.055025 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 825/1613] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:34.285623 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:34.286454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:34.292965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:34.293442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:34.294936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:34.296073 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:34.425142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:34.433156 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b40a7fb8-9f94-4a3b-9a7d-e9a8dd0ac5fd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.151658 Aug 27 03:52:34.433746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 789/1614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:34 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:35.069152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:35.070524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:35.080591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:35.081074 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:35.082061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:35.082503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:35.121723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-81ff2031-d6c3-4705-a25f-f329ecfb62fd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056635 Aug 27 03:52:35.122320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 826/1615] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:35.453276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:35.453899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:35.460087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:35.460531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:35.461327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:35.461767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:35.543576 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:35.554485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b43ab7f7-5613-4ae6-9f63-f1bea5115230 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.106030 Aug 27 03:52:35.555137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 790/1616] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:35 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:36.134883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:36.135791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:36.142434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:36.142872 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:36.143636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:36.144060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:36.174382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9702a047-f986-436c-b89d-663e3099fbcc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Aug 27 03:52:36.174971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 827/1617] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:36.575886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:36.577124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:36.583234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:36.583681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:36.584473 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:36.584911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:36.647908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:36.655963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-737d903d-6819-4f6a-b3b2-2ae0573bbeee tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.084218 Aug 27 03:52:36.656549 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 791/1618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:36 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:37.188735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:37.189715 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:37.195562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:37.196009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:37.196774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:37.197212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:37.227172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-734f28a1-b6f3-410f-86f6-6f44eea67501 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 Aug 27 03:52:37.227646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 828/1619] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:37.673888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:37.674866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:37.681523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:37.681965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:37.682767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:37.683620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:37.754592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:37.765424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-06ecf016-fab5-4751-a998-b83f10add80f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.096230 Aug 27 03:52:37.766369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 792/1620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:37 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:38.238967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:38.239881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:38.245874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:38.246330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:38.247103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:38.248205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:38.298284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-106f7f9c-9755-4ade-b475-07e706f20b32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063003 Aug 27 03:52:38.298868 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 829/1621] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:38.782470 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:38.783083 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:38.789317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:38.789762 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:38.790569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:38.790998 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:38.851635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:38.861414 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-26b3efe7-2ed4-4746-95b1-517fd750353c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082192 Aug 27 03:52:38.863063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 793/1622] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:38 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:39.311638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:39.312572 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:39.318598 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:39.319045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:39.319828 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:39.320256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:39.351166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8f2ad2bb-0c42-4462-8d26-3a5e0aad0560 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Aug 27 03:52:39.351730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 830/1623] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:39 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:39.882326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:39.882913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:39.888922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:39.889366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:39.890155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:39.890580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:39.952995 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:39.965361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2a949ea7-5609-41b2-aad5-b56882b0b8b8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.086478 Aug 27 03:52:39.966090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 794/1624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:39 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:40.363670 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:40.364504 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:40.370545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:40.370990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:40.371791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:40.372293 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:40.400506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7815a94b-1273-4924-8d83-15231fbe85ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040765 Aug 27 03:52:40.401064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 831/1625] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:40.982351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:40.982949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:40.988831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:40.989276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:40.990072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:40.990509 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:41.054033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:41.061976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-02f2baf1-c757-4581-b5ec-3fd0294ecc2b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083284 Aug 27 03:52:41.062583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 795/1626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:40 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:41.413044 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:41.413973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:41.420222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:41.420664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:41.421428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:41.421860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:41.450765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-75b83829-fe64-4b47-a0d1-4fb055b48504 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 Aug 27 03:52:41.451311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 832/1627] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:42.079158 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:42.079766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:42.085765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:42.086259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:42.087034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:42.087468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:42.149056 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:42.156351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-539d7d55-2277-4d67-ae92-54ed6417ef11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081455 Aug 27 03:52:42.156920 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 796/1628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:42 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:42.461809 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:42.462652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:42.469466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:42.469913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:42.470743 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:42.471178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:42.503053 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c22889f6-7fa5-4ee0-9f16-35401ff8ef04 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Aug 27 03:52:42.503636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 833/1629] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:43.173839 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:43.174458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:43.180585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:43.181040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:43.181796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:43.182260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:43.244710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:43.253204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aadcce1f-a7d8-42ae-be84-d113c619314f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083138 Aug 27 03:52:43.253775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 797/1630] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:43 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:43.514794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:43.515609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:43.521687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:43.522165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:43.522930 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:43.523361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:43.557360 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7fc13f55-993f-4d38-a435-b249b67840f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Aug 27 03:52:43.557647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 834/1631] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:43 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:44.270110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:44.270720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:44.276446 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:44.276888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:44.277648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:44.278094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:44.339619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:44.347425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a3d42b5c-7c06-449c-91e2-04ce195b45ca tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081112 Aug 27 03:52:44.347978 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 798/1632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:44 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:44.568736 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:44.569665 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:44.575968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:44.576490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:44.577268 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:44.577703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:44.607767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2bd7dfd8-7995-482f-b7c7-932613f830b6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Aug 27 03:52:44.608320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 835/1633] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:45.364668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:45.365245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:45.371270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:45.371714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:45.373384 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:45.373834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:45.434189 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:45.446959 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1e2e9853-210a-4c04-b309-38afd4db4028 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.086005 Aug 27 03:52:45.447536 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 799/1634] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:45 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:45.619416 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:45.620248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:45.626699 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:45.627149 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:45.627919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:45.628354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:45.657765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-eb8f1409-1bdb-44d9-92dd-639b915fecf9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Aug 27 03:52:45.658343 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 836/1635] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:46.463941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:46.464485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:46.470415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:46.470866 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:46.471638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:46.472072 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:46.532095 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:46.539361 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-40630279-35e4-43b9-b9c3-282cce68182e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079170 Aug 27 03:52:46.539912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 800/1636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:46 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:46.669614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:46.670595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:46.676695 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:46.677133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:46.677892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:46.678355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:46.708795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e0a65e57-d75d-4078-ae54-b27625a65249 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043434 Aug 27 03:52:46.709521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 837/1637] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:47.557087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:47.557770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:47.565079 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:47.565526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:47.566326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:47.566760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:47.631901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:47.639304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0af689d0-c28c-420d-aadb-58e8e386fb53 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.086298 Aug 27 03:52:47.639864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 801/1638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:47 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:47.721081 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:47.721998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:47.727939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:47.728386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:47.729153 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:47.729589 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:47.760642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-56c816db-d8db-4656-a444-4c3e4dbc1a86 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Aug 27 03:52:47.761208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 838/1639] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:48.656688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:48.657305 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:48.664218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:48.664680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:48.665475 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:48.665910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:48.732764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:48.740633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-366a2e41-9cdb-4cbf-a259-6777bf832d58 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.088096 Aug 27 03:52:48.741201 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 802/1640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:48 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:48.772655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:48.773604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:48.780573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:48.781168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:48.781948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:48.782410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:48.813278 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-04813cfd-6149-47d8-b7cf-24b7905f3d8b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Aug 27 03:52:48.813741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 839/1641] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:49.671508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:52:49.672330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:52:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:52:49.756558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:49.757170 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:49.763727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:49.764173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:49.764943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:49.765377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:49.825019 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:49.827424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:49.828304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:49.833617 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:49.834101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:49.834887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:49.835323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:49.843663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d154fcc7-e081-4089-845e-9b3827743ea8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.089108 Aug 27 03:52:49.843663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 803/1642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:49 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:49.868662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fe93efc7-e456-4785-a08f-10b29954b314 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Aug 27 03:52:49.869224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 840/1643] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:52:50.863302 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:50.863903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:50.869672 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:50.870140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:50.870918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:50.871346 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:50.880593 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:50.881676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:50.888262 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:50.888877 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:50.890157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:50.890656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:50.921830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4ef80587-00ce-453c-b3df-5b0c7ee3cd16 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Aug 27 03:52:50.922438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 841/1644] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:52:50.932506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:50.940652 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2f10448a-996e-4d69-af42-f57d5a2a6f6f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080979 Aug 27 03:52:50.941207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 804/1645] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:50 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:51.933133 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:51.934055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:51.940711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:51.941150 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:51.941904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:51.942374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:51.960327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:51.961343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:51.970357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:51.971106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:51.972313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:51.972999 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:51.985431 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-38e4a03e-8020-4dd0-86a9-24223ffdf3de tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055680 Aug 27 03:52:51.986852 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 842/1646] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:52.041640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:52.050719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b01a7102-c492-487a-865b-eed0496c9841 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.096287 Aug 27 03:52:52.051469 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 805/1647] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:51 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:53.000980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:53.001895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:53.007762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:53.008210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:53.008980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:53.009423 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:53.040182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4e7e61b3-219e-42c6-8c02-e6e3c9abb903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 27 03:52:53.040733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 843/1648] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:53.068337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:53.068967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:53.075064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:53.076196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:53.076954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:53.077378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:53.136850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:53.144983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8e008806-21ff-49aa-abb5-18e0ecfd6d5d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080143 Aug 27 03:52:53.145564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 806/1649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:53 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:54.051042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:54.052219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:54.057980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:54.058456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:54.059288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:54.060235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:54.088737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ef63a076-e82c-4646-87c8-eb675a4c9efd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041436 Aug 27 03:52:54.089790 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 844/1650] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:54.161756 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:54.162394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:54.168219 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:54.169145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:54.169915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:54.170370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:54.229850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:54.237685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3789e7f6-190c-4fe6-b17e-f275a4832902 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079586 Aug 27 03:52:54.238282 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 807/1651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:54 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:55.100221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:55.101142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:55.108012 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:55.108470 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:55.109242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:55.109677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:55.139454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0f57a38c-10e7-4a9e-835f-fc6313f8b2ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Aug 27 03:52:55.140003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 845/1652] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:55.255116 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:55.255717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:55.261454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:55.261886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:55.262945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:55.263355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:55.325092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:55.332341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-36c30db1-b8b2-4a5a-a1d3-33e9e03fcaf9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080867 Aug 27 03:52:55.333138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 808/1653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:55 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:56.150926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:56.151862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:56.158406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:56.158847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:56.159591 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:56.160014 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:56.189628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-02cbf5b2-c68f-4e2f-9725-e8a9943ceec9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042407 Aug 27 03:52:56.190217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 846/1654] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:56.349703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:56.350301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:56.356674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:56.357122 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:56.357870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:56.358326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:56.419125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:56.426644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d4dc6307-d717-4edb-8653-bbfa8fc17975 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080401 Aug 27 03:52:56.427200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 809/1655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:56 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:57.201230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:57.202164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:57.208157 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:57.208603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:57.209363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:57.209791 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:57.239203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dac11f6c-246b-4b00-ba28-d13c474211d3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Aug 27 03:52:57.239750 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 847/1656] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:57.443788 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:57.444405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:57.450374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:57.450818 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:57.451649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:57.452017 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:57.669614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:57.678128 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1fa525f1-c555-4e26-9a5a-84156927a012 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.237464 Aug 27 03:52:57.678508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 810/1657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:57 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:58.251825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:58.252873 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:58.258895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:58.259345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:58.260125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:58.260561 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:58.292908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-571fec90-7cb5-4c81-9549-b37d8b307b43 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Aug 27 03:52:58.293468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 848/1658] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:58.694338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:58.694956 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:58.701526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:58.701970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:58.702770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:58.703202 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:58.770081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:58.778835 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ae4abaed-a886-4c32-8f5d-36f098b71692 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.087980 Aug 27 03:52:58.779399 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 811/1659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:58 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:59.305522 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:59.306474 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:59.312843 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:59.313292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:59.314096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:59.314532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:59.346342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-11c567fa-174a-401f-8f46-29e139ae716e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 27 03:52:59.346908 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 849/1660] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:52:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:59.796650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:59.797255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:52:59.803869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:59.804308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:59.805074 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:52:59.805498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:52:59.866526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:59.873941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-af7dc94c-9be2-49f0-8b5e-4ae427ce6335 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082618 Aug 27 03:52:59.874523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 812/1661] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:52:59 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:00.358941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:00.359751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:00.365670 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:00.366148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:00.366924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:00.367345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:00.400546 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b199005e-ab67-4412-8c31-c597d8799633 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Aug 27 03:53:00.401104 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 850/1662] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:00 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:00.890712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:00.891314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:00.897299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:00.897796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:00.898598 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:00.899024 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:00.959108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:00.968049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e7f4272d-0f42-494b-97cf-90c4bf94714d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081908 Aug 27 03:53:00.968607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 813/1663] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:00 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:01.413138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:01.414064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:01.420060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:01.420496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:01.421253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:01.421673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:01.452186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-13d04076-7661-4e39-a74e-a0c291b6acd4 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Aug 27 03:53:01.452746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 851/1664] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:01.985705 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:01.986403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:01.992682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:01.993132 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:01.993915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:01.994375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:02.065785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:02.077329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3579f306-60bd-4aa4-bf92-44407fac84ad tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.095876 Aug 27 03:53:02.077905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 814/1665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:01 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:02.463686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:02.464596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:02.471066 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:02.471518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:02.472290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:02.472718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:02.503753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-446e51c3-f027-4b2a-a6b2-5d369db59cd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Aug 27 03:53:02.504318 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 852/1666] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:03.094291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:03.094908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:03.100897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:03.101351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:03.102153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:03.102612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:03.175461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:03.183587 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dc515806-a9f1-4743-ae5d-5b52754a14d7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.093511 Aug 27 03:53:03.184177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 815/1667] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:03 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:03.515794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:03.516696 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:03.522516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:03.522987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:03.523701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:03.524126 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:03.553507 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1767c1ee-a423-4913-8ebe-e209bf0ac4cc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 Aug 27 03:53:03.554097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 853/1668] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:04.201711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:04.202367 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:04.208428 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:04.208868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:04.209625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:04.210078 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:04.271309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:04.278574 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-748603c5-5dba-4f3f-9ce5-bd110c4cb939 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081756 Aug 27 03:53:04.279120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 816/1669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:04 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:04.565718 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:04.566652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:04.572553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:04.572986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:04.573745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:04.574211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:04.603247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-318ec84f-1dfa-434b-8fa2-2350b5645610 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041215 Aug 27 03:53:04.603800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 854/1670] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:04 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:05.296314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:05.296982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:05.303049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:05.303503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:05.304266 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:05.304736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:05.370409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:05.378407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-14e3840a-ceea-4b7f-80c6-e07c9236e4bc tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.086866 Aug 27 03:53:05.378973 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 817/1671] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:05 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:05.615329 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:05.616254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:05.623051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:05.623497 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:05.624269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:05.624700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:05.653774 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0999f8ad-91aa-4bdf-be3e-46acd959b7a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042282 Aug 27 03:53:05.654355 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 855/1672] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:06.395206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:06.395858 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:06.401625 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:06.402098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:06.403800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:06.404844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:06.468324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:06.475800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d82f653c-29c2-4b5c-a240-a0897f962fe4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.084402 Aug 27 03:53:06.476379 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 818/1673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:06 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:06.664407 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:06.665263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:06.672383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:06.672833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:06.673597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:06.674050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:06.704084 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fcb7a3ed-f690-4f29-8cfc-32ae29dab328 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Aug 27 03:53:06.704641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 856/1674] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:07.493729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:07.494370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:07.500484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:07.500933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:07.501698 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:07.502164 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:07.561916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:07.569370 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9a09706d-3fb4-4daa-87b4-e380ce7fefa5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079417 Aug 27 03:53:07.569932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 819/1675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:07 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:07.716174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:07.717089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:07.723162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:07.723691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:07.724394 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:07.724830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:07.755010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-28d91481-f4e4-432d-9aca-4f3913a2b4b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Aug 27 03:53:07.755409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 857/1676] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:08.586900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:08.587515 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:08.594281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:08.594730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:08.595498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:08.595929 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:08.666058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:08.673557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b9efbc0a-3b88-4cf7-a6ae-f34480175480 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.090436 Aug 27 03:53:08.674212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 820/1677] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:08 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:08.767046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:08.767955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:08.774575 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:08.775022 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:08.775786 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:08.776212 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:08.806206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-9fbb5aa3-b621-4f34-aba3-fa6375d738d8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 Aug 27 03:53:08.806758 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 858/1678] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:09.690413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:09.691004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:09.696875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:09.697317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:09.698146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:09.698578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:09.759130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:09.766795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4d92a8cf-76f1-4969-bc0f-9318e584a1a2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080034 Aug 27 03:53:09.767360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 821/1679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:09 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:09.818372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:09.819210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:09.825947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:09.826426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:09.827208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:09.827644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:09.857520 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e58f133c-20f9-4b69-b25f-e6321cc78281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 Aug 27 03:53:09.858085 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 859/1680] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:10.783455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:10.784054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:10.789915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:10.790381 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:10.791137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:10.791562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:10.852356 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:10.860468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d08ea546-24c9-4f6c-b101-edb1353d71ac tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080707 Aug 27 03:53:10.861036 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 822/1681] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:10 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:10.868518 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:10.869433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:10.876382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:10.876823 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:10.877588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:10.878035 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:10.907862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1e74c417-f5b7-49f9-8f9a-1ba74bfc0811 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042995 Aug 27 03:53:10.908420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 860/1682] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:11.877870 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:11.878502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:11.884306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:11.884744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:11.885502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:11.885928 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:11.919232 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:11.920184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:11.926515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:11.926964 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:11.927749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:11.928190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:11.947591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:11.957560 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-822b364c-b119-4078-a9a1-3be278e44de3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081938 Aug 27 03:53:11.958168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 823/1683] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:11 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:11.966357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a7b9c4e4-a230-48bc-b6d1-ff7fdd0d981c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050737 Aug 27 03:53:11.966934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 861/1684] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:53:12.974666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:12.975285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:12.976363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:12.977283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:12.982060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:12.982503 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:12.983251 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:12.983676 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:12.983788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:12.984169 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:12.984939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:12.985367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:13.019225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b1e07609-319f-4c72-bd54-ad35af645892 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046500 Aug 27 03:53:13.019992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 862/1685] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:53:13.047331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:13.055100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8bba6d97-9ecd-4b14-a541-fdbfeda4bf62 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.084046 Aug 27 03:53:13.055681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 824/1686] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:12 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:14.036569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:14.037465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:14.043448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:14.043914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:14.044673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:14.045102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:14.071413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:14.072139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:14.073722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1c1874f8-f394-47ce-bcac-80f1ae87a471 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Aug 27 03:53:14.074330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 863/1687] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:14.078863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:14.079507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:14.080199 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:14.080627 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:14.140312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:14.147648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-239c94e3-bf11-4d34-b0c6-ae7075baf9ff tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080036 Aug 27 03:53:14.148195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 825/1688] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:14 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:53:15.085992 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:15.086949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:15.093569 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:15.093996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:15.094776 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:15.095258 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:15.124544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5538af87-d933-4556-a443-253ddb2a45ee tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042320 Aug 27 03:53:15.125125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 864/1689] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:15.164864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:15.165499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:15.172548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:15.173001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:15.173772 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:15.174240 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:15.241107 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:15.248955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e0ea984c-bd36-4847-8540-8e38c2d83664 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.087787 Aug 27 03:53:15.249505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 826/1690] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:15 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:16.135216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:16.136132 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:16.142638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:16.143107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:16.143855 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:16.144281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:16.173574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-72fb73c4-370d-41b1-b474-31175d7cb8b8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042058 Aug 27 03:53:16.174148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 865/1691] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:16.265812 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:16.266448 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:16.272360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:16.272797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:16.273558 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:16.273979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:16.336819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:16.345261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f5935f19-2d23-48b2-9b21-e135e084d743 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083060 Aug 27 03:53:16.345833 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 827/1692] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:16 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:17.185384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:17.186342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:17.192197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:17.192646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:17.193412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:17.193844 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:17.222694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-97e8ed25-e227-4736-84be-30759573b0d5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041822 Aug 27 03:53:17.223245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 866/1693] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:17.362332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:17.362949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:17.368820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:17.369271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:17.370055 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:17.370493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:17.430840 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:17.438450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-12a021a8-ec6f-4c7b-8307-558baafb5f1f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079643 Aug 27 03:53:17.438923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 828/1694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:17 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:18.234969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:18.235884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:18.241659 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:18.242136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:18.242891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:18.243327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:18.271862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3cb712ec-b6c9-471a-8c72-b059c4bbf281 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 Aug 27 03:53:18.272422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 867/1695] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:18.455080 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:18.455636 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:18.461496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:18.461936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:18.462736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:18.463168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:18.522658 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:18.530407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f589adc7-78e1-4b48-87d7-e5e4ea148282 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079043 Aug 27 03:53:18.530975 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 829/1696] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:18 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:19.283947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:19.284861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:19.290749 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:19.291199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:19.291961 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:19.292395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:19.322698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8b34b0c1-f0d2-4711-ba25-fc1fe894ee59 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 Aug 27 03:53:19.323253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 868/1697] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:19.547388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:19.547955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:19.555052 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:19.555492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:19.556254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:19.556887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:19.619749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:19.627886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3259f38f-8480-4202-9ad8-08e0a44ef973 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.084637 Aug 27 03:53:19.628440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 830/1698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:19 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:20.334432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:20.335393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:20.341814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:20.342288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:20.343070 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:20.343500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:20.374702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ae705b08-a3c0-4917-9723-70ae0e96f47c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 27 03:53:20.375184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 869/1699] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Aug 27 03:53:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:20.645440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:20.646047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:20.651797 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:20.652231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:20.653075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:20.653495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:20.712407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:20.719799 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5b156c6a-498b-475c-8d5b-953fe0851c97 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.078284 Aug 27 03:53:20.720348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 831/1700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:20 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:21.385896 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:21.387445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:21.393235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:21.393675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:21.394458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:21.394880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:21.486539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3a5a83d0-d6ec-4488-b266-0ff67bcf5364 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action" status: 200 len: 41582 microversion: 2.1 time: 0.104040 Aug 27 03:53:21.487272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 870/1701] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 03:53:21 2021] POST /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c/action => generated 41582 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:53:21.736795 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:21.737409 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:21.743552 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:21.743993 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:21.744759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:21.745190 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:21.808450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:21.816664 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-29369c99-4f5a-43aa-a4fd-d855bdf028e8 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083491 Aug 27 03:53:21.817254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 832/1702] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:21 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:53:22.834127 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:22.834737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:22.841302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:22.841739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:22.842531 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:22.842955 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:22.906302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:22.913650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-21e7cc91-db8e-44c4-9cc8-78165a21d12d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083665 Aug 27 03:53:22.914245 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 871/1703] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:22 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:23.930754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:23.931349 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:23.937290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:23.937741 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:23.938534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:23.938970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:23.999329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:24.007345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cc111f44-29e8-4ba3-9141-68c410f79724 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080309 Aug 27 03:53:24.007927 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 833/1704] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:23 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:25.025341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:25.025985 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:25.032890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:25.033336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:25.034125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:25.034560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:25.095476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:25.102732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fc0fb38e-bb31-4bf9-b7db-aee7b3e26db6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081161 Aug 27 03:53:25.103281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 872/1705] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:25 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:26.119611 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:26.120223 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:26.126315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:26.126759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:26.127526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:26.127963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:26.189239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:26.196507 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c6792301-98ee-400e-8511-6b59140d804a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080507 Aug 27 03:53:26.197077 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 834/1706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:26 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:27.213960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:27.214544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:27.222034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:27.222444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:27.223205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:27.223631 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:27.282361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:27.289472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d6f4bb8-b4fe-4151-9d3e-5694a74ec90a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079253 Aug 27 03:53:27.290034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 873/1707] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:27 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:28.304513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:53:28.307732 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:28.308335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:28.314856 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:28.315292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:28.316041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:28.316466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:28.378582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:28.385798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-263d6385-9aa3-46d5-a017-2e33c505970c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082582 Aug 27 03:53:28.386387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 835/1708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:28 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:29.401392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:29.402064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:29.407923 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:29.408369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:29.409124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:29.409554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:29.469596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:29.476792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-88f17a6f-b1cc-44ad-bc41-dbf90d9073b5 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079069 Aug 27 03:53:29.477348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 874/1709] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:29 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:30.493478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:30.494136 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:30.517278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:30.517742 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:30.519324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:30.519790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:30.521588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50242. Aug 27 03:53:30.582865 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:30.590743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-01f9f8ac-9959-4008-bdea-d30ea24f83bb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.100874 Aug 27 03:53:30.591295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 836/1710] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:30 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:31.607742 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:31.608356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:31.614610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:31.615055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:31.615822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:31.616253 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:31.678138 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:31.685870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c5f7a946-c138-4961-be7b-81bb38c93d5b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082376 Aug 27 03:53:31.686457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 875/1711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:31 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:32.702557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:32.703198 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:32.709063 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:32.709508 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:32.710311 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:32.710744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:32.770345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:32.778916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2637918c-fca3-42b9-85e5-09ec231cc9e4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080240 Aug 27 03:53:32.779590 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 837/1712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:32 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:33.796064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:33.796826 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:33.803770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:33.804220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:33.805000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:33.805437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:33.882998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:33.891222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0e98a411-24b8-4090-acb8-e43962d18820 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.098920 Aug 27 03:53:33.891800 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 876/1713] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:33 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:34.909029 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:34.909646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:34.915596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:34.916042 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:34.916809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:34.917250 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:34.978239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:34.986134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6b9565f6-12a5-4912-a2ff-b502b3ecbee1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080794 Aug 27 03:53:34.986700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 838/1714] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:34 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:36.003765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:36.005239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:36.011184 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:36.011895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:36.012835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:36.013275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:36.073071 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:36.080845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-240ab02d-ed31-4a15-93ef-352b0761e6b1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081356 Aug 27 03:53:36.081412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 877/1715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:35 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:37.098320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:37.098861 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:37.104712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:37.105754 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:37.106518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:37.106968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:37.168045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:37.175484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-92ba60cc-ae38-42e4-b886-841a2d1d1002 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080874 Aug 27 03:53:37.176498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 839/1716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:37 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:38.193989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:38.194545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:38.200924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:38.201418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:38.202186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:38.202607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:38.262677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:38.270045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-77540d51-ced3-4789-9bd0-e0c79b8d64a9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079778 Aug 27 03:53:38.270608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 878/1717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:38 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:39.288284 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:39.288883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:39.294845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:39.295279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:39.296033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:39.296454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:39.357863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:39.365322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-81c94cb2-e59e-4112-bb8e-fe064dabd36a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080727 Aug 27 03:53:39.365884 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 840/1718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:39 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:40.383306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:40.383912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:40.392666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:40.393114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:40.393889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:40.394354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:40.459662 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:40.467882 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-02342f6b-4c07-4bdd-9058-528465dfb5c6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.088285 Aug 27 03:53:40.468454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 879/1719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:40 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:41.485068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:41.485681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:41.491626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:41.492070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:41.492834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:41.493265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:41.553333 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:41.561115 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e58ba606-0993-4c61-bb7c-8c8db0d21205 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079663 Aug 27 03:53:41.561675 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 841/1720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:41 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:42.578422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:42.579017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:42.584972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:42.585426 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:42.586213 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:42.586646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:42.647739 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:42.655273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6eb9d959-9216-4686-82e9-14e4ece5e3d4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080486 Aug 27 03:53:42.655854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 880/1721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:42 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:43.673378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:43.673981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:43.680239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:43.680684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:43.681456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:43.681889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:43.744900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:43.752641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-312777f1-598b-4fc6-aef2-c7e40f4613b7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082969 Aug 27 03:53:43.753208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 842/1722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:43 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:44.771661 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:44.772305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:44.779028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:44.779472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:44.780244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:44.780680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:44.842813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:44.850141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-918cf64b-85ae-461c-8649-58bda7e36336 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082144 Aug 27 03:53:44.850697 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 881/1723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:44 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:45.867037 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:45.867653 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:45.873495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:45.873965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:45.874813 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:45.875175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:45.936681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:45.944049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-470e5d93-91e6-40e2-918c-469500e8a492 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080659 Aug 27 03:53:45.944612 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 843/1724] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:45 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:46.960854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:46.961464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:46.968204 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:46.968643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:46.969410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:46.969838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:47.034737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:47.042086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2d956dc6-5681-4e2a-9799-0ac14ed13a08 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.084894 Aug 27 03:53:47.042709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 882/1725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:46 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:48.059953 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:48.060559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:48.066475 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:48.066921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:48.067694 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:48.068124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:48.132500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:48.140689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2609fe62-d419-45da-9376-43fdcb44be84 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.085102 Aug 27 03:53:48.141259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 844/1726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:48 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:49.156754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:49.157398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:49.163242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:49.163687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:49.164445 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:49.164874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:49.224268 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:49.232314 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-84c27d9f-5aa5-4f0d-8a35-310b0cdb26eb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079198 Aug 27 03:53:49.232879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 883/1727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:49 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:53:50.249313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:50.249898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:50.255735 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:50.256168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:50.256925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:50.257345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:50.318436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:50.326343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-2c2eb55f-08ce-4711-a122-4af4f11f5455 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080713 Aug 27 03:53:50.326910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 845/1728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:50 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:51.343185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:51.343792 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:51.349760 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:51.350241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:51.351011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:51.351453 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:51.410900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:51.419208 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3a5563a1-aaeb-4e76-bc0c-d8c29ab8a59d tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079782 Aug 27 03:53:51.419763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 884/1729] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:51 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:52.436785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:52.437338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:52.443206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:52.443651 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:52.444417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:52.444864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:52.503899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:52.512047 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c38aba8b-53a9-4a93-af00-d48846639a0a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079064 Aug 27 03:53:52.512620 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 846/1730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:52 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:53.529063 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:53.529646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:53.535532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:53.535976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:53.536730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:53.537155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:53.600033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:53.608366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f0ad925f-a98f-4c8a-8d6d-a78efdc37d11 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083323 Aug 27 03:53:53.608953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 885/1731] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:53 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:54.625340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:54.625949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:54.631892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:54.632366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:54.633166 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:54.633599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:54.698388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:54.706539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b8e1d01d-6592-49e2-960f-8d0eb1042b7e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.085005 Aug 27 03:53:54.707110 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 847/1732] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:54 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:55.724317 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:55.724900 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:55.732011 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:55.732462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:55.733241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:55.733676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:55.795559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:55.803338 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-aa5ad04c-e221-42fd-99e8-aa17f668a281 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082724 Aug 27 03:53:55.803910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 886/1733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:55 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:56.820808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:56.821543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:56.827557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:56.828006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:56.828789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:56.829221 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:56.891747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:56.899513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-52e5ecb8-73d0-4640-94fb-847f63253500 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082415 Aug 27 03:53:56.900081 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 848/1734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:56 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:57.917365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:57.918617 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:57.927087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:57.927529 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:57.928323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:57.928759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:57.992679 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:58.001820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-88140eb1-bfb4-459c-a6d6-4c4c94b8e2a7 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.088201 Aug 27 03:53:58.002428 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 887/1735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:57 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:59.018766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:59.019350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:53:59.025885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:59.026375 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:59.027909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:53:59.028343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:53:59.087261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:59.095633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e449b4f9-9ab3-49ea-93ff-af274d28752f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080487 Aug 27 03:53:59.096197 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 849/1736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:53:59 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:00.112595 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:00.113176 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:00.119015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:00.119462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:00.120783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:00.121254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:00.189906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:00.197780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e3ce9294-7dc1-441b-b9e9-ad79af946c4b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.088830 Aug 27 03:54:00.198971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 888/1737] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:00 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:01.216016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:01.216635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:01.222938 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:01.223411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:01.224208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:01.224646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:01.285919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:01.293942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f7012716-811b-458e-b95d-0e8a3b3d2084 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082974 Aug 27 03:54:01.294530 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 850/1738] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:01 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:02.311455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:02.312041 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:02.317892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:02.318364 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:02.319118 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:02.319543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:02.381294 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:02.388954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5462e65e-e996-44ac-a4b3-28b5ef39d8dd tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081749 Aug 27 03:54:02.389506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 889/1739] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:02 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:03.405894 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:03.406505 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:03.412315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:03.412755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:03.413683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:03.414054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:03.474906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:03.483299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a9bf8b06-e526-4733-9cf3-b0f7f6848170 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081305 Aug 27 03:54:03.483867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 851/1740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:03 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:04.500441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:04.501036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:04.507030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:04.507465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:04.508229 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:04.508654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:04.572694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:04.581145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-64dea175-190e-4078-935e-3e673327fd2a tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.084298 Aug 27 03:54:04.581714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 890/1741] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:04 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:05.598177 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:05.598787 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:05.604613 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:05.605053 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:05.605911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:05.606275 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:05.668515 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:05.676212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-45d6e368-9b12-4435-aa9a-2843a8155aeb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081493 Aug 27 03:54:05.676778 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 852/1742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:05 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:06.694752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:06.695425 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:06.703638 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:06.704078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:06.704848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:06.705275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:06.769402 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:06.777493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6be9ea81-a6de-459f-946c-9ced2efbe5c2 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.087985 Aug 27 03:54:06.778078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 891/1743] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:06 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:07.794794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:07.795391 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:07.801643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:07.802103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:07.802940 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:07.803363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:07.864663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:07.872606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8707bfe0-d0ba-458a-8c56-27ce487a1ce4 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082178 Aug 27 03:54:07.873159 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 853/1744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:07 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:08.889193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:08.889785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:08.895683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:08.896121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:08.896899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:08.897325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:08.957820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:08.965910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-04886535-72fc-4de7-9b9e-a8a97a991bb6 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080481 Aug 27 03:54:08.966496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 892/1745] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:08 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:09.983196 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:09.983809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:09.989564 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:09.990020 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:09.990801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:09.991232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:10.053454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:10.061584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-986f3c26-d113-4e89-8497-702d95b111be tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082747 Aug 27 03:54:10.062182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 854/1746] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:09 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:11.078691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:11.079334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:11.085217 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:11.085664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:11.086464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:11.086887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:11.146633 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:11.154180 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7663e175-9259-4b61-909a-380a9b1eead1 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079165 Aug 27 03:54:11.154745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 893/1747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:11 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:12.171310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:12.171921 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:12.178087 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:12.178541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:12.179300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:12.179733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:12.238586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:12.245966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0785885b-80de-4dd3-b3b6-d57a6573a3ec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.078992 Aug 27 03:54:12.246563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 855/1748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:12 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:13.262472 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:13.263079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:13.268759 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:13.269219 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:13.269966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:13.270412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:13.333703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:13.341854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cb8f29e8-1a0d-4117-add4-abb4e9fa6329 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083000 Aug 27 03:54:13.342432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 894/1749] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:13 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:14.358441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:14.359089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:14.365290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:14.365736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:14.366534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:14.366962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:14.429714 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:14.442287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-66f7ccfd-085b-4f2d-8420-c49ea61d3d0c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.087458 Aug 27 03:54:14.442867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 856/1750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:14 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:15.459840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:15.460448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:15.467342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:15.467840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:15.468602 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:15.469026 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:15.528389 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:15.535541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0dc31771-3079-477a-a1ba-f6d08509abbb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079298 Aug 27 03:54:15.536143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 895/1751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:15 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:16.552502 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:16.553108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:16.559249 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:16.559688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:16.560447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:16.560868 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:16.620969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:16.628167 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a4c8e2f2-4421-464c-b127-134e6dcfca44 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079553 Aug 27 03:54:16.628716 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 857/1752] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:16 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:16.870893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:16.871408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:16.877091 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:16.877539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:16.878342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:16.878798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:16.892088 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] HTTP exception thrown: Instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 could not be found. Aug 27 03:54:16.892697 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Returning 404 to user: Instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:54:16.893506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4f65e3fe-5978-4caa-bf48-3a6988791603 tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 404 len: 111 microversion: 2.1 time: 0.026380 Aug 27 03:54:16.894037 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 896/1753] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:54:16 2021] DELETE /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:54:16.902474 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:16.903089 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] [instance: bef4e7c3-65e5-4239-b56a-84761b4b7cc5] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:16.908776 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:16.909214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:16.909967 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:16.910421 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:16.923586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] HTTP exception thrown: Instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 could not be found. Aug 27 03:54:16.924161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] Returning 404 to user: Instance bef4e7c3-65e5-4239-b56a-84761b4b7cc5 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:54:16.925006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cbec7a6f-eb67-48a3-9525-4cb5c7c8d84b tempest-AttachVolumeShelveTestJSON-267268157 tempest-AttachVolumeShelveTestJSON-267268157-project] 10.222.0.48 "GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5" status: 404 len: 111 microversion: 2.1 time: 0.027031 Aug 27 03:54:16.925778 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 858/1754] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:16 2021] GET /compute/v2.1/servers/bef4e7c3-65e5-4239-b56a-84761b4b7cc5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:54:17.644502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:17.645115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:17.650801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:17.651990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:17.652775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:17.653202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:17.713437 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:17.721535 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-592f9fc1-f1e7-446a-ac6c-d042be1f377b tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.080677 Aug 27 03:54:17.722419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 897/1755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:17 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:18.738949 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:18.740301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:18.747294 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:18.747748 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:18.748548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:18.748977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:18.813119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:18.822424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-369069d8-031a-4df8-8f1c-afd3ba0d53fb tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.087100 Aug 27 03:54:18.824179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 859/1756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:18 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:19.840061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:19.840726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:19.846562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:19.847002 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:19.847789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:19.848210 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:19.918701 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:19.928463 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4e90301e-e583-4662-b39a-34efabafe4ed tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.092078 Aug 27 03:54:19.930332 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 898/1757] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:19 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:54:20.947728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:20.948974 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:20.954667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:20.955112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:20.955873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:20.956307 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:21.016290 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:21.023809 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-04683beb-9d0d-4de9-8b08-7de658e03066 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079738 Aug 27 03:54:21.024568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 860/1758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:20 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:22.040304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:22.044525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:22.050863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:22.051311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:22.052083 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:22.052515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:22.113270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:22.121941 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ae6694e8-88b6-48cc-8bb4-ba15f9d0774e tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.085099 Aug 27 03:54:22.123043 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 899/1759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:22 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:23.140373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:23.140925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:23.146779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:23.147215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:23.147968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:23.148392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:23.207451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:23.215411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-92f79620-5c14-4f5b-afee-49e6a1374ba3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079402 Aug 27 03:54:23.215968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 861/1760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:23 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:24.233020 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:24.233637 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:24.239466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:24.239911 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:24.240682 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:24.241114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:24.303165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:24.311076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e1c34f98-9ce2-43e3-849f-77d61a4b5b4c tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082770 Aug 27 03:54:24.311624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 900/1761] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:24 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:25.328124 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:25.328727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:25.334588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:25.335021 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:25.335768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:25.336193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:25.395521 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:25.403392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b1c0301c-fcf8-4785-b7d4-0dca3ad7bac3 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.078937 Aug 27 03:54:25.403947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 862/1762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:25 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:26.419939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:26.420490 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:26.426779 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:26.427220 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:26.427981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:26.428401 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:26.490745 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:26.498586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ad74019c-285d-4381-a307-7996cd9f4561 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082711 Aug 27 03:54:26.499146 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 901/1763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:26 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:26.889479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:26.889706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:54:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:54:27.515114 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:27.515731 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:27.521498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:27.521943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:27.522734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:27.523165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:27.582365 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:27.590342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-577cf37f-d529-4d32-9863-68eac7c1bbec tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.078886 Aug 27 03:54:27.590908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 863/1764] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:27 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:28.607580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:28.608193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:28.614542 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:28.615038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:28.615814 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:28.616248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:28.678899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:28.686579 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b56c7503-09e3-4954-85f8-e0ab6c06a272 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.083758 Aug 27 03:54:28.687139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 902/1765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:28 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:29.703273 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:29.703882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:29.709680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:29.710155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:29.710919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:29.711347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:29.770684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:29.778755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-33f35f80-8f05-492c-a3c8-2e22cb618a55 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079122 Aug 27 03:54:29.779315 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 864/1766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:29 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:30.795574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:30.796399 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:30.803109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:30.803480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:30.804207 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:30.804628 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:30.865867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:30.873684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-818342e4-0ebd-4802-92cc-3b7aaf2d65d9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.081920 Aug 27 03:54:30.874264 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 903/1767] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:30 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:31.890968 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:31.891563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:31.897331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:31.897771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:31.898559 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:31.898988 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:31.959280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:31.967040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7a250132-6707-4f99-91ac-3857a61a513f tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.079885 Aug 27 03:54:31.967596 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 865/1768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:31 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:32.361050 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:32.361204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:54:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:54:32.984600 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:32.985239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:32.991469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:32.991912 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:32.992684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:32.993097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:33.055457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883257742b64642887adffbe4f0a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77e3c5a0d4923a18d3f98ccb523a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:33.063229 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c4db518f-ad6f-4c5d-bbd8-247cf9285b27 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 200 len: 1225 microversion: 2.1 time: 0.082321 Aug 27 03:54:33.063787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 904/1769] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:32 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:54:34.081013 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:34.081798 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: a1a03aa5-2406-4897-ab82-ed8c62cdab4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:34.090522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:34.091330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:34.092400 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:34.092838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:34.107324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] HTTP exception thrown: Instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c could not be found. Aug 27 03:54:34.107837 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Returning 404 to user: Instance a1a03aa5-2406-4897-ab82-ed8c62cdab4c could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:54:34.108702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-573f5951-0ebd-49b2-acbb-6c070af6e6aa tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c" status: 404 len: 111 microversion: 2.1 time: 0.032376 Aug 27 03:54:34.109239 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 866/1770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:34 2021] GET /compute/v2.1/servers/a1a03aa5-2406-4897-ab82-ed8c62cdab4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:54:34.565981 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:34.566505 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:34.572503 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:34.573781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:34.574505 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:34.574934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:34.588238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] HTTP exception thrown: Instance 259f7cfe-9ee5-44ec-b227-d524587c5600 could not be found. Aug 27 03:54:34.588830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Returning 404 to user: Instance 259f7cfe-9ee5-44ec-b227-d524587c5600 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:54:34.589645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-96e6c8b9-fe4e-480f-9d28-93e937f82fb9 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "DELETE /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 404 len: 111 microversion: 2.1 time: 0.027339 Aug 27 03:54:34.590195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 905/1771] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:54:34 2021] DELETE /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:54:34.598057 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:34.598649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] [instance: 259f7cfe-9ee5-44ec-b227-d524587c5600] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:54:34.604529 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:34.604969 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:34.605719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:34.606191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:34.618848 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] HTTP exception thrown: Instance 259f7cfe-9ee5-44ec-b227-d524587c5600 could not be found. Aug 27 03:54:34.619941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Returning 404 to user: Instance 259f7cfe-9ee5-44ec-b227-d524587c5600 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:54:34.620737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e01a9ee2-c496-4fa6-8a10-bee1b99b1760 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600" status: 404 len: 111 microversion: 2.1 time: 0.026409 Aug 27 03:54:34.621244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 867/1772] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:54:34 2021] GET /compute/v2.1/servers/259f7cfe-9ee5-44ec-b227-d524587c5600 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:54:48.344316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:48.345051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:54:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:54:53.653621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:53.654184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:54:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:56:09.689034 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:56:09.689645 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:56:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:56:36.272411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:56:36.272929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:56:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:57:46.907158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:57:46.908017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:57:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:57:52.379203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:57:52.379918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:57:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:58:08.363390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:58:08.364052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 03:58:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:58:13.670783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:58:13.671440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:58:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:59:21.166247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:59:21.170181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:21.170713 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:21.178475 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:21.178920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:21.179705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:21.180136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:21.207016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:59:21.294353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-10ec0a9d-2167-48bb-977b-f47a62097411 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 204 len: 0 microversion: 2.1 time: 0.129931 Aug 27 03:59:21.294931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 906/1773] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 03:59:21 2021] DELETE /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:59:21.302343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:59:21.306232 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:21.306869 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:21.313790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:21.314326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:21.315257 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:21.315820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:21.619673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:21.633470 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3557d757-16e5-415f-a89b-dac74679a929 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1717 microversion: 2.1 time: 0.333148 Aug 27 03:59:21.634673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 868/1774] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1717 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:22.655241 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:22.656214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:22.689730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:22.690505 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:22.692111 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:22.692578 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:22.699866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52954. Aug 27 03:59:23.062777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:23.075987 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-54a274c9-27ed-4996-a0cf-0162798b2a38 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1717 microversion: 2.1 time: 0.426607 Aug 27 03:59:23.077235 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 907/1775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1717 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:23.673207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52970. Aug 27 03:59:23.775362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-885bda46-5778-4ade-a92f-4f1fac6b8a7e req-5d010c0f-3123-4411-97e9-4b2c55104e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ffde52-808b-45c5-8e77-3a763ad6db4c", "name": "network-vif-deleted", "tag": "d24d4ce4-d453-4fce-9851-c391c52874bb"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:59:23.777076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:59:23.777076 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 03:59:23.785712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-885bda46-5778-4ade-a92f-4f1fac6b8a7e req-5d010c0f-3123-4411-97e9-4b2c55104e9f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:23.786285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-885bda46-5778-4ade-a92f-4f1fac6b8a7e req-5d010c0f-3123-4411-97e9-4b2c55104e9f service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:23.799295 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-885bda46-5778-4ade-a92f-4f1fac6b8a7e req-5d010c0f-3123-4411-97e9-4b2c55104e9f service nova] Creating event network-vif-deleted:d24d4ce4-d453-4fce-9851-c391c52874bb for instance e1ffde52-808b-45c5-8e77-3a763ad6db4c on hv-cinder-77398 Aug 27 03:59:23.807632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-885bda46-5778-4ade-a92f-4f1fac6b8a7e req-5d010c0f-3123-4411-97e9-4b2c55104e9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159003 Aug 27 03:59:23.808638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 869/1776] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 03:59:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:59:24.097081 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:24.097704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:24.104714 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:24.105148 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:24.106211 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:24.106642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:24.185250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:24.195248 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-273832bf-e30f-4044-a1cd-23dbe0ab65a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.101857 Aug 27 03:59:24.196121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 908/1777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:59:25.220415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:25.221085 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:25.227622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:25.228070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:25.228847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:25.229277 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:25.292291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:25.300592 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-275bf604-d6cd-45cc-b247-93fe44e89a36 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084429 Aug 27 03:59:25.301710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 870/1778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:59:26.326689 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:26.327588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:26.334586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:26.335045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:26.335927 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:26.336369 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:26.407752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:26.416869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-284c332f-d01b-4273-a115-38e36a3c6af8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.093975 Aug 27 03:59:26.417449 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 909/1779] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:27.436451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:27.437028 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:27.443666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:27.444109 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:27.444906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:27.445344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:27.518832 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:27.528740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dc7ba6de-0a00-4b40-ade4-ea0d848cda62 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.095880 Aug 27 03:59:27.529386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 871/1780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:28.548048 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:28.548979 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:28.556834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:28.558223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:28.558223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:28.558608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:28.632692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:28.641079 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6bd3ebda-7a09-447b-9048-49cbaf783258 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.096722 Aug 27 03:59:28.641741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 910/1781] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:29.659425 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:29.660061 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:29.667291 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:29.667739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:29.668542 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:29.668970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:29.706740 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:59:29.707140 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 03:59:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c (ip 10.222.0.48) !!! Aug 27 03:59:29.740045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:29.748286 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-30a08f19-cc05-4cdd-add5-924fe81f16e6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.092953 Aug 27 03:59:29.748891 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 872/1782] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:30.767239 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:30.767890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:30.774436 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:30.774883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:30.775673 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:30.776107 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:30.848524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:30.860250 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-363338af-38ab-4212-ba7e-119bf7a7d8ea tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.097251 Aug 27 03:59:30.860874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 911/1783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:31.878466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:31.879766 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:31.886235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:31.886687 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:31.887476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:31.887914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:31.958091 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:31.966192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3bc8f59e-5f4c-46b0-bf06-24238071431f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.091451 Aug 27 03:59:31.966768 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 873/1784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:32.982652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:32.983272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:32.990499 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:32.990947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:32.991744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:32.992182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:33.063272 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:33.072928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2558c5a7-8340-4c18-8729-ffb2bc0364c9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.093889 Aug 27 03:59:33.073610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 912/1785] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:34.099350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:34.099966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:34.106135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:34.106586 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:34.107376 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:34.107811 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:34.173911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:34.183108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-36315fa4-be45-4880-ae80-396e57a6ed90 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.087687 Aug 27 03:59:34.183700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 874/1786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:35.201170 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:35.201802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:35.209671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:35.210141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:35.210918 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:35.211345 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:35.275517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:35.284105 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-07ce0d9a-9a29-4f4b-9ac2-b99637b33c2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086718 Aug 27 03:59:35.284684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 913/1787] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:35 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:59:36.302130 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:36.302962 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:36.309064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:36.309506 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:36.310325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:36.310764 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:36.378360 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:36.387880 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ec64dd09-0a45-40fd-8c7f-0624f8750dff tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.089966 Aug 27 03:59:36.388476 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 875/1788] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:37.406168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:37.406954 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:37.414174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:37.414623 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:37.415433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:37.415861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:37.491741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:37.499996 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-42b5e7a4-5616-4b5c-8856-f96b83207694 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.097491 Aug 27 03:59:37.500574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 914/1789] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:38.520852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:38.521621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:38.527679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:38.528120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:38.528912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:38.529344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:38.601555 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:38.609650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f0ffcd44-c351-4f65-bbe9-fc58b5e729c0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.093060 Aug 27 03:59:38.610263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 876/1790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:39.630381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:39.631427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:39.641775 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:39.642588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:39.643972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:39.645959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:39.730938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:39.745421 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-bbe6e3cb-9e0a-4715-ad56-ae11d3fb5903 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.120075 Aug 27 03:59:39.746500 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 915/1791] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:39 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:40.773119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:40.773773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:40.779943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:40.780389 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:40.781173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:40.781609 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:40.850344 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:40.863212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7ba7fd53-f600-4df8-8e29-27197969c1d9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.094351 Aug 27 03:59:40.864595 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 877/1792] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:41.881762 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:41.882462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:41.888632 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:41.889075 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:41.891712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:41.892168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:41.961586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:41.973281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c7e14564-ed24-4e31-84a6-d1e1592952da tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.094943 Aug 27 03:59:41.973835 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 916/1793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:42.991646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:42.992272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:42.998462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:42.998919 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:42.999726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:43.000165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:43.067471 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:43.075720 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-78b1ac17-9a74-4853-baa2-89551c3e2e83 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.088951 Aug 27 03:59:43.076312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 878/1794] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:44.092603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:44.093256 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:44.099414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:44.099861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:44.100649 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:44.101077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:44.165592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:44.173751 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5ba4833d-04e4-4e00-a3fe-2379fec52c1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084532 Aug 27 03:59:44.174466 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 917/1795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:45.191441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:45.192127 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:45.198054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:45.198493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:45.199259 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:45.199681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:45.263327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:45.271575 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1efa81db-229a-42b8-afee-a73bcc428e94 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083740 Aug 27 03:59:45.272147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 879/1796] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:46.288588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:46.289183 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:46.295517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:46.295990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:46.296783 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:46.297282 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:46.382684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:46.391763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-40701854-f5a3-4fd0-bde4-fcc330b88fd9 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.106773 Aug 27 03:59:46.392366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 918/1797] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:47.408701 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:47.409313 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:47.416477 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:47.416925 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:47.417712 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:47.418193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:47.480058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:47.490330 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-028333cc-8f0d-46c8-bb0a-466e6bbe4a8a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.085300 Aug 27 03:59:47.490913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 880/1798] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:48.508178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:48.508781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:48.514880 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:48.515328 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:48.516102 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:48.516539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:48.582664 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:48.591111 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-683953b8-1304-4a51-a932-678aff12aa9c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086924 Aug 27 03:59:48.591691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 919/1799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:49.609203 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:49.609821 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:49.617329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:49.617790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:49.618604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:49.619040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:49.683946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:49.692374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-1025b6e8-9091-4361-b7e0-6993c90e221a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086930 Aug 27 03:59:49.692946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 881/1800] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:50.709746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:50.710325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:50.717395 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:50.717849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:50.718691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:50.719135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:50.781983 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:50.791311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7341cdce-a2b6-441d-b21a-1937369f1b98 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.085601 Aug 27 03:59:50.791898 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 920/1801] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:51.809183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:51.809897 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:51.816626 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:51.817337 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:51.818310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:51.818924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:51.883395 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:51.891274 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6b8b6cdc-3e0d-43d0-bbc2-a7cc74e441ba tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.085830 Aug 27 03:59:51.891846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 882/1802] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:52.909390 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:52.910634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:52.917216 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:52.917728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:52.918553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:52.918989 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:52.981967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:52.990348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ac0fc4c2-317d-402a-a7e0-551828022bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084807 Aug 27 03:59:52.990925 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 921/1803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:54.008394 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:54.009032 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:54.015445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:54.015893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:54.016660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:54.017094 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:54.079429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:54.087207 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6c3eb161-0e50-4df3-a4b4-844d37dff983 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083142 Aug 27 03:59:54.087758 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 883/1804] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:55.104367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:55.105067 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:55.111193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:55.111663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:55.112433 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:55.113058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:55.176642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:55.184469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2c7d43b9-83f9-4be7-a489-14e59804cb80 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083735 Aug 27 03:59:55.185021 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 922/1805] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:56.203101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:56.203790 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:56.211276 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:56.211730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:56.212511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:56.212946 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:56.279185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:56.288205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-320fd1ef-5d79-408d-9205-775df6734d33 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.088992 Aug 27 03:59:56.288873 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 884/1806] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:57.305347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:57.305968 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:57.312018 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:57.312489 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:57.313249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:57.313683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:57.379864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:57.387785 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e5ad695a-a856-4bae-ba5f-b2a217432a29 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086072 Aug 27 03:59:57.388348 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 923/1807] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:58.405483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:58.406206 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:58.413308 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:58.413755 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:58.414610 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:58.415138 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:58.478513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:58.486909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f28e8ae2-0866-41af-9bf6-52cc89dfb69d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.085192 Aug 27 03:59:58.487491 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 885/1808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:59.505413 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:59.506173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:59:59.513223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:59.513744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:59.514773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:59:59.515260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:59:59.586047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:59.600959 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d630038-1f68-4945-882a-9c9a2edbcc56 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.099825 Aug 27 03:59:59.602032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 924/1809] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 03:59:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:00.627917 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:00.629292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:00.636109 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:00.636560 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:00.637386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:00.637822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:00.709301 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:00.719451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-620ee6e3-885c-4b17-8e34-c49f4156d50d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.095285 Aug 27 04:00:00.720045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 886/1810] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:00 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:01.736246 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:01.736904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:01.743657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:01.744090 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:01.744858 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:01.745283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:01.808849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:01.817458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-80f244d4-d92e-4837-996d-28f4058d6345 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084847 Aug 27 04:00:01.826973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 925/1811] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:02.835218 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:02.835801 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:02.841794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:02.842279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:02.843059 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:02.843495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:02.907105 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:02.922339 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8e43ce62-770b-4d9d-9e8b-87f2cb0cf27d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.091401 Aug 27 04:00:02.923388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 887/1812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:03.948693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:03.949296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:03.955331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:03.955772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:03.957224 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:03.957761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:04.023559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:04.032305 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-200a990a-771d-40f0-8a58-708e382124a8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.087272 Aug 27 04:00:04.032980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 926/1813] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:05.050423 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:05.051048 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:05.057265 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:05.057721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:05.058608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:05.059033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:05.124086 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:05.132887 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7cbf5a21-668c-48de-b2d8-4f46cb7a4b77 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086389 Aug 27 04:00:05.133642 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 888/1814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:06.150781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:06.151412 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:06.157406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:06.157860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:06.158684 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:06.159117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:06.225948 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:06.233890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ebbe3a1c-01bf-43c5-9417-32fc0acb4e39 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086966 Aug 27 04:00:06.234624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 927/1815] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:07.251436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:07.252016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:07.258941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:07.259526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:07.260450 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:07.261434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:07.338900 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:07.347663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-00c54ef0-9cc7-42d3-9fca-9e526aa2e5b3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.099501 Aug 27 04:00:07.348248 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 889/1816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:08.369671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:08.370557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:08.381392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:08.382275 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:08.383796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:08.384603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:08.450990 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:08.459543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0079b171-9411-41a1-b219-ecdfab906fd6 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.097834 Aug 27 04:00:08.460143 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 928/1817] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:09.477410 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:09.478318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:09.485796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:09.486640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:09.488665 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:09.489660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:09.568210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:09.576775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-007d5485-44c4-4440-82c4-339b09573fd5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.103502 Aug 27 04:00:09.577351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 890/1818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:10.594611 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:10.595222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:10.601796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:10.602358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:10.603135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:10.603560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:10.665532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:10.674304 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74bef284-823b-4975-a4e2-dbb255aa8358 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083298 Aug 27 04:00:10.674936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 929/1819] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:11.691892 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:11.692534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:11.698325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:11.698773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:11.699533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:11.699964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:11.762826 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:11.771161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-45a66a97-1837-439b-aeac-66ce1ae093f3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083699 Aug 27 04:00:11.771834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 891/1820] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:12.788581 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:12.789205 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:12.795096 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:12.795541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:12.796309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:12.796741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:12.863292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:12.870848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d82eec63-eeb4-4e89-a9ba-f7f97bf0a1f7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086366 Aug 27 04:00:12.871352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 930/1821] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:13.888103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:13.888684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:13.895619 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:13.896067 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:13.896842 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:13.897272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:13.959725 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:13.967533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-cc95344d-51cf-4848-b2c1-846c7c5cb628 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083200 Aug 27 04:00:13.968092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 892/1822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:13 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:14.985128 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:14.985897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:14.992869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:14.993398 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:14.994260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:14.994698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:15.060334 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:15.068971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-28e6814e-801c-4ebd-9f2f-1727caf461ed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.087884 Aug 27 04:00:15.069580 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 931/1823] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:16.087980 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:16.088584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:16.095647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:16.096100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:16.096954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:16.097401 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:16.172641 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:16.183119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e2347f67-5dfd-4383-be24-70f980ead15e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.098777 Aug 27 04:00:16.183709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 893/1824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:17.201544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:17.202144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:17.209349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:17.209788 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:17.210607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:17.211035 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:17.284015 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:17.294757 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-79b72f83-83eb-4d00-b24e-8b38f4841693 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.096701 Aug 27 04:00:17.295840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 932/1825] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:18.315217 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:18.316324 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:18.322945 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:18.323393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:18.324185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:18.324622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:18.405516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:18.416643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-49d85809-22d7-4313-9366-bc372d3c165d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.104701 Aug 27 04:00:18.419406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 894/1826] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:19.437055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:19.437636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:19.444656 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:19.445103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:19.445887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:19.446346 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:19.513728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:19.522125 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4ffbb4e5-b9f7-4fa3-95b1-ff37fdc9dce2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.088845 Aug 27 04:00:19.522704 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 933/1827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:20.539398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:20.540016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:20.546522 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:20.546955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:20.547621 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:20.548215 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:20.612205 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:20.621403 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5912e9e7-57a4-4cb4-b0d0-cad1d0fcfc3d tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.085676 Aug 27 04:00:20.621977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 895/1828] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:21.642441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:21.643031 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:21.649717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:21.650198 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:21.650973 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:21.651408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:21.715430 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:21.724515 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8c5fbad1-7812-4df5-a75d-327e6bc16429 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.085587 Aug 27 04:00:21.725124 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 934/1829] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:22.742497 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:22.743180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:22.749190 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:22.749634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:22.750436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:22.750954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:22.813146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:22.821496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4fd6f836-26ae-4274-a6ee-cc48edab26fe tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.082723 Aug 27 04:00:22.822145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 896/1830] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:23.838052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:23.838825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:23.844904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:23.845323 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:23.846134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:23.846594 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:23.910251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:23.918005 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0866ed15-62cb-4bf5-b7e3-3e506a1a994a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083946 Aug 27 04:00:23.918585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 935/1831] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:23 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:24.935875 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:24.936487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:24.943466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:24.943934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:24.944719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:24.945287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:25.014531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:25.022970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5bf9bba2-b782-4f4d-a745-97ff9113c362 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.090961 Aug 27 04:00:25.023533 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 897/1832] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:26.040709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:26.041347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:26.052324 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:26.053027 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:26.053845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:26.054326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:26.128032 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:26.136746 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c8e0ac12-de1d-454a-b2b9-8e6ca4428eb8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.099793 Aug 27 04:00:26.137238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 936/1833] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:27.154570 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:27.155398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:27.165834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:27.166317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:27.167101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:27.167539 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:27.247661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:27.261518 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8e28d70a-ae6b-4af4-83d5-31c824d85a92 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.110411 Aug 27 04:00:27.262526 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 898/1834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:27 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:28.279804 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:28.280460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:28.287533 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:28.287976 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:28.288767 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:28.289197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:28.355550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:28.364055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-08f9b5bb-d582-404d-ad0a-67c38b448c32 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.087881 Aug 27 04:00:28.364642 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 937/1835] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:28 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:29.381363 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:29.382111 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:29.388726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:29.389179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:29.390084 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:29.390449 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:29.465101 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:29.475653 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6402328f-1421-4c4f-84f2-b8a241743584 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.098119 Aug 27 04:00:29.476430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 899/1836] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:29 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:30.494806 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:30.495491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:30.501803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:30.502358 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:30.503478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:30.504060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:30.574313 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:30.583744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8c055646-2095-4c6e-b086-c920a9a86cd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.092633 Aug 27 04:00:30.584325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 938/1837] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:30 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:31.600707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:31.601325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:31.607212 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:31.607660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:31.608422 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:31.608855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:31.671465 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:31.681334 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-23c478c8-7e58-4497-8513-d2710e0bc554 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084558 Aug 27 04:00:31.681905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 900/1838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:31 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:32.698725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:32.699459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:32.705434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:32.706565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:32.707443 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:32.707922 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:32.776929 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:32.785980 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d9e64c0-5d59-42ef-a5b5-bdc303a2c216 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.091103 Aug 27 04:00:32.786608 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 939/1839] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:32 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:33.803582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:33.804441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:33.810437 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:33.810888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:33.811667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:33.812098 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:33.882045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:33.890340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f57397c1-801a-41e8-87d1-309158000b68 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.091054 Aug 27 04:00:33.890918 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 901/1840] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:33 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:34.438564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7e465589-dd97-4748-acc7-7f841e065315 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] Calling method '.version_select at 0x7fb1308a48b0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:34.467890 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7e465589-dd97-4748-acc7-7f841e065315 tempest-TestVolumeBootPattern-987627553 tempest-TestVolumeBootPattern-987627553-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-699246540" status: 202 len: 0 microversion: 2.1 time: 0.032856 Aug 27 04:00:34.468464 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 940/1841] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Aug 27 04:00:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-699246540 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:00:34.919103 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:34.920041 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:34.926174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:34.926624 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:34.927451 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:34.927882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:35.004989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:35.018108 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d7b00d0d-1f4f-482b-bf41-a0a18d643582 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.104070 Aug 27 04:00:35.020369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 902/1842] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:34 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:36.045221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:36.046935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:36.055938 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:36.056562 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:36.057376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:36.057920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:36.136978 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:36.149541 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-fddca21c-1245-4475-9a72-d8e7c0bc8074 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.112593 Aug 27 04:00:36.150296 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 941/1843] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:36 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:37.169574 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:37.170414 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:37.180241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:37.180923 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:37.182569 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:37.183342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:37.270728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:37.280683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3df321e7-04ee-4f85-83c2-2c5e48e1a307 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.116300 Aug 27 04:00:37.282661 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 903/1844] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:37 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:38.303050 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:38.304444 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:38.313302 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:38.313848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:38.314772 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:38.316077 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:38.410392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:38.438528 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8965b899-3185-4ee0-9e1a-38816986f189 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.128750 Aug 27 04:00:38.441249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 942/1845] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:38 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:39.468789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:39.469463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:39.475952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:39.476452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:39.477439 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:39.477933 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:39.569674 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:39.578102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-8b7d1e01-e0e1-4c8e-a4f1-11cee64dc9bc tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.113252 Aug 27 04:00:39.578686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 904/1846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:39 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:40.602574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:40.603962 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:40.614693 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:40.615364 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:40.617092 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:40.617895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:40.749825 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:40.766214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-15a8b52d-c02c-4268-b420-90150f9538e8 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.167486 Aug 27 04:00:40.767485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 943/1847] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:40 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:41.784359 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:41.785460 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:41.792145 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:41.792855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:41.793794 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:41.794398 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:41.882304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:41.895092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-86c9dc9d-7305-4061-b14f-3c7a0ac87fd7 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.114313 Aug 27 04:00:41.897440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 905/1848] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:41 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:42.921009 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:42.922555 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:42.930414 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:42.930958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:42.931879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:42.932582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:43.009137 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:43.025707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5d395616-fda7-4b56-874d-0f0a7da4a6b2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.108257 Aug 27 04:00:43.042261 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 944/1849] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:42 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:44.046982 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:44.047844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:44.057648 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:44.058348 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:44.059287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:44.059721 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:44.139670 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:44.149524 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-961fb7de-24cb-4f29-bb6e-edbab9d01496 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.106546 Aug 27 04:00:44.150139 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 906/1850] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:44 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:45.167255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:45.168155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:45.175875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:45.176456 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:45.177372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:45.177897 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:45.255300 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:45.264366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-afa57336-e1a5-47d7-90dd-451f3c0a1d9f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.100795 Aug 27 04:00:45.265152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 945/1851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:45 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:46.282970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:46.283608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:46.291718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:46.292492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:46.293852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:46.294660 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:46.384649 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:46.393511 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aba1a7c5-cf76-460b-9f76-9a63426bd10a tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.113678 Aug 27 04:00:46.394159 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 907/1852] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:46 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:47.412276 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:47.412875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:47.419538 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:47.419991 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:47.420782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:47.421215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:47.485564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:47.495064 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-78bdeb08-07b6-4e90-be50-465302280a57 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.087683 Aug 27 04:00:47.495663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 946/1853] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:47 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:48.513237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:48.514045 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:48.521800 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:48.522327 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:48.523118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:48.523545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:48.611211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:48.620492 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f6146f3b-a94a-408e-a5b7-db685b0794b1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.111305 Aug 27 04:00:48.621001 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 908/1854] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:48 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:49.640218 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:49.640893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:49.648024 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:49.648543 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:49.649339 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:49.649863 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:49.716046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:49.725652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b023e4b1-9ea9-4de2-b224-3b39704330ec tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.089233 Aug 27 04:00:49.726283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 947/1855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:49 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:50.743960 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:50.744572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:50.750591 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:50.751043 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:50.751825 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:50.752260 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:50.829594 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:50.838776 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4300ddeb-1a12-401b-953a-787471ecd622 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.098497 Aug 27 04:00:50.839374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 909/1856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:50 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:51.858123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:51.858884 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:51.866854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:51.867295 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:51.868076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:51.868705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:51.933194 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:51.941609 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7f255b57-ba5d-47db-bcd2-54f759a623a1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.088622 Aug 27 04:00:51.942209 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 948/1857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:51 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:52.957770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:52.958441 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:52.966926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:52.967689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:52.968802 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:52.969245 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:53.038578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:53.046824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b3a287a4-995c-4fc7-8cc9-030a01ca0aed tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.092721 Aug 27 04:00:53.047408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 910/1858] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:52 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:54.064599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:54.065834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:54.080288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:54.081382 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:54.082226 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:54.082663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:54.148415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:54.156730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2f595c26-34c0-4b9b-9626-a90a9d3140dd tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.095875 Aug 27 04:00:54.157308 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 949/1859] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:54 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:55.176854 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:55.177628 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:55.184424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:55.184883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:55.185667 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:55.186129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:55.248700 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:55.257915 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-66b109be-9237-4f83-a664-f09343c4f81e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.086284 Aug 27 04:00:55.258525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 911/1860] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:55 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:56.275202 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:56.275811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:56.281975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:56.282452 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:56.283380 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:56.284347 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:56.347152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:56.355193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-629dc4c4-9fee-4148-9776-c70feb9ec12e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.083636 Aug 27 04:00:56.355754 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 950/1861] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:56 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:57.372711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:57.373383 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:57.379688 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:57.380125 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:57.380901 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:57.381408 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:57.448977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:57.457741 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-96a7c988-15aa-47dc-88f5-1199da44f192 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.089326 Aug 27 04:00:57.458468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 912/1862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:57 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:58.475116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:58.475732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:58.482034 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:58.482480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:58.483244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:58.483677 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:58.546892 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:58.555685 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-542d8dec-7397-41c5-8f23-bd1f30c23d1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084267 Aug 27 04:00:58.556254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 951/1863] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:58 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:59.572990 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:59.573607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:00:59.579702 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:59.580147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:59.580972 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:59.581729 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:59.645896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:59.653888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-aec8bde3-50c6-45a6-9abb-040a29567bf1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.084622 Aug 27 04:00:59.654563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 913/1864] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:00:59 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:00.673599 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:00.674851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:00.682468 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:00.682957 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:00.683700 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:00.684135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:00.748999 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:00.757773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3fcaa97e-62b7-46b8-9ac4-da5c69f34b27 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.088439 Aug 27 04:01:00.758397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 952/1865] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:00 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:01:01.777016 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:01.777699 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:01.784378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:01.785030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:01.794989 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:01.795444 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:01.864718 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:01.878195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d2aeda91-2ed6-4ab2-a752-ac6301fc24a3 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.103645 Aug 27 04:01:01.879578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 914/1866] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:01 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:02.899051 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:02.899940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:02.906712 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:02.907166 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:02.907971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:02.908384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:02.974353 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:02.982676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-103c02e2-1053-439f-9227-3dd0dd569690 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.089647 Aug 27 04:01:02.983263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 953/1867] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:02 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:04.003746 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:04.004459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:04.011388 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:04.011914 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:04.012711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:04.013147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:04.082540 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:04.090941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5037951c-f1a9-4194-a616-d1ce76cd9f6b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.090890 Aug 27 04:01:04.091523 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 915/1868] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:03 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:05.110907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:05.111530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:05.118502 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:05.118860 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:05.119885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:05.120324 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:05.193583 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:05.205269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e4ef88da-ab69-4fb4-9d42-2caf7eb19418 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.097575 Aug 27 04:01:05.206849 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 954/1869] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:05 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:06.229287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:06.229940 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:06.236049 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:06.236499 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:06.237857 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:06.238662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:06.307468 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:06.316614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0322b9f2-7b06-44f3-9364-136de41cca14 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.091633 Aug 27 04:01:06.317204 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 916/1870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:06 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:06.926613 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:01:06.927230 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:01:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:01:07.333510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:07.334173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:07.342764 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:07.343363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:07.344257 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:07.344782 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:07.409686 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:07.417822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-82d46b68-6994-43e6-b968-e69a2d9bd911 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.088473 Aug 27 04:01:07.418432 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 955/1871] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:07 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:08.435461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:08.436209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:08.443186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:08.443638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:08.444439 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:08.444880 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:08.520100 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:08.528578 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-09bcaa21-70b6-4d6d-ad21-f4d09e9ab2ac tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.097024 Aug 27 04:01:08.529162 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 917/1872] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:08 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:09.546361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:09.547072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:09.557177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:09.558030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:09.559388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:09.560189 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:09.630936 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:09.641325 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-abf2a1f7-26b2-4dda-b092-3c50bf78f0a2 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.098633 Aug 27 04:01:09.641921 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 956/1873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:09 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:10.660588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:10.661216 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:10.667970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:10.668447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:10.669243 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:10.669682 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:10.740791 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:10.749027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-00e41d31-e2ae-48da-8637-1bcae5a3c45e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.093482 Aug 27 04:01:10.749606 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 918/1874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:10 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:11.768564 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:11.769582 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:11.776236 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:11.776680 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:11.777471 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:11.777904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:11.850222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:11.871781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3fd9398e-90d0-40ab-af9c-d06ee68d9e0e tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.106933 Aug 27 04:01:11.872516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 957/1875] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:11 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:12.397711 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:01:12.398413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:01:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:01:12.897453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:12.898393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:12.904876 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:12.905316 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:12.906122 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:12.906551 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:12.985926 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:13.000372 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-60a1f34e-7eea-4924-ad31-e9b6e1d4cc2c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.106088 Aug 27 04:01:13.007976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 919/1876] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:12 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:14.017681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:14.019003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:14.026175 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:14.026770 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:14.027640 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:14.028144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:14.097839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:14.106319 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2197c840-7486-4770-9339-f1edc9fb5093 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.092438 Aug 27 04:01:14.106970 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 958/1877] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:14 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:15.126575 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:15.127271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:15.136104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:15.136733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:15.137836 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:15.138520 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:15.228319 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:15.237355 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6e82135d-9dd9-4d11-8193-1d3c6df32ab1 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.115666 Aug 27 04:01:15.238160 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 920/1878] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:15 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:16.254411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:16.255028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:16.261116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:16.261687 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:16.262727 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:16.263223 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:16.335234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:16.343988 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a2a8fac7-a80f-4ab4-82f6-fb2464e3189c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.093544 Aug 27 04:01:16.344688 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 959/1879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:16 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:17.362958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:17.362958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:17.371306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:17.371877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:17.372943 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:17.373571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:17.453033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:17.464543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9fe16d90-63b2-4e87-b150-ed392d3c4a1b tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.106438 Aug 27 04:01:17.465119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 921/1880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:17 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:18.484222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:18.485330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:18.493994 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:18.494486 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:18.495592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:18.496367 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:18.577376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:18.587847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-256247ca-e55b-41c6-8933-c64f5fabeef0 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.108672 Aug 27 04:01:18.588438 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 960/1881] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:18 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:01:19.616387 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:19.617850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:19.626341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:19.626804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:19.629683 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:19.630188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:19.704347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:19.713884 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-257a6c19-1758-4b4c-b773-64d813002356 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.105091 Aug 27 04:01:19.714628 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 922/1882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:19 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:20.732610 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:20.733350 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:20.740214 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:20.740663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:20.741457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:20.741887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:20.812121 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:20.821459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-736cfff3-984e-4192-a49c-d51ce315ef1c tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.092733 Aug 27 04:01:20.822072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 961/1883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:20 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:21.849941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:21.850850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:21.858253 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:21.858844 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:21.862483 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:21.863149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:21.945545 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:21.954180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ed7dd891-fe1a-4a19-a7d2-517309707af5 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.111375 Aug 27 04:01:21.954916 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 923/1884] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:21 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:22.972566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:22.973185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:22.979625 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:22.980080 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:22.980876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:22.981306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:23.064155 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:23.075867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-c4d19ef3-cccf-4227-ba63-7aee7540476f tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1367 microversion: 2.1 time: 0.106765 Aug 27 04:01:23.076887 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 962/1885] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:22 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:24.105454 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:24.106179 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:24.113615 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:24.114104 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:24.114903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:24.115343 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:24.148947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:24.149392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:24.149850 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lazy-loading 'fault' on Instance uuid e1ffde52-808b-45c5-8e77-3a763ad6db4c {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:01:24.201510 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f04482c6e04433bbfdfc30616162e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d7d769521e4286baaa5fc29a8f22ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:24.209934 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-3bcf7eb7-db94-4595-9dd3-ced5fb546063 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 200 len: 1461 microversion: 2.1 time: 0.108326 Aug 27 04:01:24.210571 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 924/1886] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:24 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 1461 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:01:25.235812 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:25.237349 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:01:25.243516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:25.243953 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:25.244741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:25.245178 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:25.262878 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] HTTP exception thrown: Instance e1ffde52-808b-45c5-8e77-3a763ad6db4c could not be found. Aug 27 04:01:25.263482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Returning 404 to user: Instance e1ffde52-808b-45c5-8e77-3a763ad6db4c could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:01:25.264336 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-378cd134-76d6-471c-8aea-4d3977db0d30 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 404 len: 111 microversion: 2.1 time: 0.032478 Aug 27 04:01:25.264978 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 963/1887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:01:25 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:01:25.274493 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-e250104a-3448-4634-8fa6-308fc1ba0612 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '.version_select at 0x7fb1305e3040>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:25.299616 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-e250104a-3448-4634-8fa6-308fc1ba0612 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-159797962" status: 202 len: 0 microversion: 2.1 time: 0.028332 Aug 27 04:01:25.300195 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 925/1888] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Aug 27 04:01:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-159797962 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:01:36.291400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:01:36.292045 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:01:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:02:49.725752 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:02:49.726438 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:02:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:03:08.385627 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:08.386259 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:03:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:04:26.945722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:04:26.946485 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:04:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:04:32.417402 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:04:32.418118 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:04:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:04:53.694733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:04:53.695401 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:04:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:04:56.309780 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:04:56.310419 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:04:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:06:09.743767 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:06:09.744405 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:06:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:06:28.402692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:06:28.403327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:06:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:07:46.964290 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:46.964986 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:07:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:07:52.435279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:52.435888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:07:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:08:13.712723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:08:13.713445 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:08:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:08:16.327087 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:08:16.327728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:08:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:09:29.762256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:09:29.762886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:09:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:09:48.421190 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:09:48.421798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:09:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:11:06.981644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:06.982410 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:11:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:11:12.454745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:12.455342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:11:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:11:33.730293 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:33.730909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:11:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:11:36.344972 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:36.346078 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:11:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:12:49.523819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:49.753914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Action: 'create', calling method: .version_select at 0x7fb1308a4b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-131174055"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:49.772732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Getting quotas for project 814e05e5f20b4f4588cdb9be1602d70f. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:12:49.776750 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Getting quotas for user 8a7f659c1c3b4f148436e57eefd8b693 and project 814e05e5f20b4f4588cdb9be1602d70f. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:12:49.779304 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:12:49.779777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:12:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:12:49.789545 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [62fb3ba6-2fec-46e0-b674-8b4fda9350c7] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:12:50.541028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 58344. Aug 27 04:12:50.807470 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [62fb3ba6-2fec-46e0-b674-8b4fda9350c7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 58346. Aug 27 04:12:51.053487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Getting quotas for project 814e05e5f20b4f4588cdb9be1602d70f. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:12:51.056939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Getting quotas for user 8a7f659c1c3b4f148436e57eefd8b693 and project 814e05e5f20b4f4588cdb9be1602d70f. Resources: {'key_pairs'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:12:51.071676 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f99ee8c2-2660-4303-9fd9-5fc22481034d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 1.549669 Aug 27 04:12:51.072479 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 964/1889] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Aug 27 04:12:49 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:15.730485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:13:15.734719 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-21494870", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-131174055", "security_groups": [{"name": "tempest-secgroup-smoke-1593467031"}], "networks": [{"uuid": "28bd1dfe-6657-448c-8420-457cc7fd5d76"}], "block_device_mapping_v2": [{"uuid": "d2ff1c6e-83b9-4ebf-a455-405a21c49fbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:15.939691 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.network.neutron [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] validate_networks() for [('28bd1dfe-6657-448c-8420-457cc7fd5d76', None, None, None, None, None)] {{(pid=109037) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:13:16.404527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Flavor limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:13:16.404944 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Image limits 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:13:16.405407 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Flavor pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:13:16.405806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Image pref 0:0:0 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:13:16.406270 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.virt.hardware [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:13:16.415449 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:16.415886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:16.416669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:16.417093 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:16.433662 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Getting quotas for project 814e05e5f20b4f4588cdb9be1602d70f. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:13:16.437462 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.quota [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Getting quotas for user 8a7f659c1c3b4f148436e57eefd8b693 and project 814e05e5f20b4f4588cdb9be1602d70f. Resources: {'cores', 'ram', 'instances'} {{(pid=109037) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:13:16.497566 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Going to run 1 instances... {{(pid=109037) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:13:16.499747 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2ff1c6e-83b9-4ebf-a455-405a21c49fbf',volume_size=None,volume_type=None)] {{(pid=109037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:13:16.621593 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-4acce0bf-8aa2-472e-bea4-af1a97b10b6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.892731 Aug 27 04:13:16.622263 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 926/1890] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 04:13:15 2021] POST /compute/v2.1/servers => generated 406 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:13:16.632703 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dbf7a9d7-15f4-4ebd-bd23-4b73bf4e6d6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:16.633361 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dbf7a9d7-15f4-4ebd-bd23-4b73bf4e6d6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:16.738652 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dbf7a9d7-15f4-4ebd-bd23-4b73bf4e6d6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:16.745185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dbf7a9d7-15f4-4ebd-bd23-4b73bf4e6d6f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1086 microversion: 2.1 time: 0.116303 Aug 27 04:13:16.745815 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 965/1891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:16 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1086 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:17.773210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:17.773820 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:17.780777 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:17.781268 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:17.781955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:17.782951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:17.801951 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 58570. Aug 27 04:13:17.859487 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:17.867534 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-988b1a79-d9d0-46b0-8892-840cd753803a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1202 microversion: 2.1 time: 0.108697 Aug 27 04:13:17.868184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 927/1892] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:17 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:18.884521 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:18.885251 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:18.891597 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:18.892550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:18.893489 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:18.894326 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:19.110947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:19.118303 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d73939ac-f8fc-4b0c-b2fb-7fa5a39d2251 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.237419 Aug 27 04:13:19.119061 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 966/1893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:18 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:19.305776 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-b03b92c1-d8d6-4958-8f74-360c2bcdb367 req-fb55abec-29b0-4c5b-8b27-46ed64a2df34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:19.307630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:19.307630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:13:19.316443 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-b03b92c1-d8d6-4958-8f74-360c2bcdb367 req-fb55abec-29b0-4c5b-8b27-46ed64a2df34 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:19.316890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-b03b92c1-d8d6-4958-8f74-360c2bcdb367 req-fb55abec-29b0-4c5b-8b27-46ed64a2df34 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:19.328309 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-b03b92c1-d8d6-4958-8f74-360c2bcdb367 req-fb55abec-29b0-4c5b-8b27-46ed64a2df34 service nova] Creating event network-changed:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:13:19.335434 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-b03b92c1-d8d6-4958-8f74-360c2bcdb367 req-fb55abec-29b0-4c5b-8b27-46ed64a2df34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106130 Aug 27 04:13:19.336027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 928/1894] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:20.135725 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:20.136388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:20.142249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:20.142795 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:20.143619 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:20.144135 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:20.312874 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:20.321058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d5e39cd1-4a9d-405e-850d-4927f0fe822f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.189153 Aug 27 04:13:20.321621 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 967/1895] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:20 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:21.338390 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:21.339071 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:21.345427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:21.345817 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:21.346723 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:21.347153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:21.473644 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:21.480906 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-f0a243ff-0bfa-4f45-a448-198895cebd5b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.146598 Aug 27 04:13:21.481824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 929/1896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:21 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:22.497916 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:22.498576 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:22.504691 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:22.505134 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:22.505943 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:22.506434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:22.627671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:22.635018 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-cb344651-43da-4fbe-8268-3c850995fa9f tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.140952 Aug 27 04:13:22.635574 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 968/1897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:22 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:23.652345 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:23.652950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:23.659442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:23.659881 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:23.660646 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:23.661075 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:23.781420 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:23.789171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-dc446880-4d9e-4675-ab65-7c0ea5493902 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.140496 Aug 27 04:13:23.789728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 930/1898] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:23 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:24.806316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:24.806931 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:24.812803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:24.813195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:24.814653 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:24.815115 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:24.935834 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:24.944164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a15c0ecc-4417-44e2-8ee5-311b3b1771f0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.141467 Aug 27 04:13:24.944730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 969/1899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:24 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:25.960955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:25.961556 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:25.967278 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:25.967717 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:25.968480 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:25.968908 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:26.090707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:26.097997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a983d186-dd6a-47a2-944c-e96688fe3550 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.140684 Aug 27 04:13:26.098583 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 931/1900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:25 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:26.911646 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:26.912145 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:26.917928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:26.918406 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:26.919162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:26.919592 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:26.933532 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] HTTP exception thrown: Instance e1ffde52-808b-45c5-8e77-3a763ad6db4c could not be found. Aug 27 04:13:26.934152 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Returning 404 to user: Instance e1ffde52-808b-45c5-8e77-3a763ad6db4c could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:13:26.934966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7f894a1e-22d5-47bd-9eed-d66b01df1e21 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 404 len: 111 microversion: 2.1 time: 0.027060 Aug 27 04:13:26.935487 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 970/1901] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 04:13:26 2021] DELETE /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:26.943816 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:26.944419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: e1ffde52-808b-45c5-8e77-3a763ad6db4c] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:26.950289 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:26.950728 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:26.951481 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:26.951903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:26.964760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] HTTP exception thrown: Instance e1ffde52-808b-45c5-8e77-3a763ad6db4c could not be found. Aug 27 04:13:26.965342 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Returning 404 to user: Instance e1ffde52-808b-45c5-8e77-3a763ad6db4c could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:13:26.966186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0f395d9c-6cd6-4a95-a148-c9d330d69985 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c" status: 404 len: 111 microversion: 2.1 time: 0.025976 Aug 27 04:13:26.966706 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 932/1902] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:26 2021] GET /compute/v2.1/servers/e1ffde52-808b-45c5-8e77-3a763ad6db4c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:27.116801 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:27.117341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:27.123203 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:27.123647 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:27.124408 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:27.124842 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:27.246117 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:27.253343 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-6294b7f1-a4c1-44fd-a21f-0a6626271c1d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.140336 Aug 27 04:13:27.253899 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 971/1903] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:27 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:28.097733 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:28.098366 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:28.104147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.104599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.105373 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.105808 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.119732 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] HTTP exception thrown: Instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 could not be found. Aug 27 04:13:28.120321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Returning 404 to user: Instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:13:28.121165 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6fb8d75d-a9c7-4f89-8de3-14d2e0b31e52 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 404 len: 111 microversion: 2.1 time: 0.027934 Aug 27 04:13:28.121890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 933/1904] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 04:13:28 2021] DELETE /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:28.130381 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:28.131018 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] [instance: 356e4fdd-62a5-42e5-bb50-a576d9338e22] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:28.136726 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.137174 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.137950 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.138411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.152231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] HTTP exception thrown: Instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 could not be found. Aug 27 04:13:28.152881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] Returning 404 to user: Instance 356e4fdd-62a5-42e5-bb50-a576d9338e22 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:13:28.153672 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1d1b5ef7-19e2-4d58-b593-13d347c29373 tempest-AttachVolumeTestJSON-1451582301 tempest-AttachVolumeTestJSON-1451582301-project] 10.222.0.48 "GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22" status: 404 len: 111 microversion: 2.1 time: 0.027945 Aug 27 04:13:28.154249 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 972/1905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:28 2021] GET /compute/v2.1/servers/356e4fdd-62a5-42e5-bb50-a576d9338e22 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:28.270924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:28.271547 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:28.277504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.277952 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.278775 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.279210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.760976 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:28.769281 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5de6801e-3e75-4d7e-af54-ef9b8d59d831 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.503251 Aug 27 04:13:28.770127 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 934/1906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:28 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:29.786787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:29.787362 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:29.793292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:29.793732 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:29.794524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:29.794969 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:29.999042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:30.006641 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ec8554c0-fe27-481f-9830-1f72e6d2631b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.224303 Aug 27 04:13:30.007215 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 973/1907] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:29 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:30.296261 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-edeec653-ce47-4fc2-827b-96a29caa80b3 req-404db94b-e712-4c8c-8bd9-c20d0aa95721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "name": "network-vif-plugged", "status": "completed", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:30.298525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:30.298525 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:13:30.309504 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-edeec653-ce47-4fc2-827b-96a29caa80b3 req-404db94b-e712-4c8c-8bd9-c20d0aa95721 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:30.310129 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-edeec653-ce47-4fc2-827b-96a29caa80b3 req-404db94b-e712-4c8c-8bd9-c20d0aa95721 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:30.330527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-edeec653-ce47-4fc2-827b-96a29caa80b3 req-404db94b-e712-4c8c-8bd9-c20d0aa95721 service nova] Creating event network-vif-plugged:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:13:30.337082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-edeec653-ce47-4fc2-827b-96a29caa80b3 req-404db94b-e712-4c8c-8bd9-c20d0aa95721 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109915 Aug 27 04:13:30.338312 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 935/1908] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:13:31.023793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:31.024427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:31.039733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:31.040454 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:31.041247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:31.041683 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:31.190847 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:31.198803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-01c3439e-1fd1-4c6f-90ee-e935c85d4986 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1258 microversion: 2.1 time: 0.178621 Aug 27 04:13:31.199441 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 974/1909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:31 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:32.216544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:32.217237 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:32.223689 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:32.224141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:32.224911 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:32.225347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:32.349562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:32.357332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-19dfd434-c300-46bd-9614-af0405c8109d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1443 microversion: 2.1 time: 0.144809 Aug 27 04:13:32.358173 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 936/1910] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:32 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1443 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:32.373909 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:32.374560 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:32.380368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:32.380803 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:32.381553 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:32.381984 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:32.510550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:32.518368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-92bb7fcc-0277-44df-b344-70ebf92d49b4 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1443 microversion: 2.1 time: 0.148039 Aug 27 04:13:32.518958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 975/1911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:32 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:34.897845 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-47bde369-1b0f-41ce-ba26-6508e6b95ca7 req-736f0181-0029-48f1-ac21-485066dcd10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:34.899440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:34.899440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:13:34.906553 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-47bde369-1b0f-41ce-ba26-6508e6b95ca7 req-736f0181-0029-48f1-ac21-485066dcd10a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:34.907827 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-47bde369-1b0f-41ce-ba26-6508e6b95ca7 req-736f0181-0029-48f1-ac21-485066dcd10a service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:34.920457 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-47bde369-1b0f-41ce-ba26-6508e6b95ca7 req-736f0181-0029-48f1-ac21-485066dcd10a service nova] Creating event network-changed:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:13:34.926834 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-47bde369-1b0f-41ce-ba26-6508e6b95ca7 req-736f0181-0029-48f1-ac21-485066dcd10a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249685 Aug 27 04:13:34.927638 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 937/1912] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:27.009837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:27.009837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:14:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:14:32.473224 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:32.473841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:14:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:14:56.364341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:56.364851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:14:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:15:05.462269 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-592964567", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "80353014-5249-42ff-8f3c-8f5139aa2059"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:05.513168 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] validate_networks() for [('80353014-5249-42ff-8f3c-8f5139aa2059', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:15:05.916519 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:15:05.916947 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:15:05.917424 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:15:05.917839 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:15:05.918280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:15:05.927861 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:05.928309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:05.929113 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:05.929547 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:05.946824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Getting quotas for project af2f83a6efc64cc4adef358d27182277. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:15:05.950735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Getting quotas for user 45fc7c98bb9245c5b4947cc72343db7d and project af2f83a6efc64cc4adef358d27182277. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:15:05.961331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:15:05.963654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:15:06.008876 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7eac1454-9cfb-4782-bdbc-f528f0291de6 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551106 Aug 27 04:15:06.009524 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 976/1913] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 04:15:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:15:06.021357 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-04b8d385-43b3-4dae-9455-8d815a02ae71 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:06.022092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-04b8d385-43b3-4dae-9455-8d815a02ae71 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:06.075634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-04b8d385-43b3-4dae-9455-8d815a02ae71 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:06.082149 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-04b8d385-43b3-4dae-9455-8d815a02ae71 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1218 microversion: 2.1 time: 0.065962 Aug 27 04:15:06.082709 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 938/1914] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:06 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:15:07.100271 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:07.101565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:07.108270 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:07.109497 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:07.110405 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:07.110841 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:07.220372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:07.228309 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-39833b63-a224-4717-8c26-4f7c59623b97 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1276 microversion: 2.1 time: 0.132187 Aug 27 04:15:07.228869 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 977/1915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:07 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:08.245836 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:08.246500 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:08.254285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:08.254726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:08.255513 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:08.255941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:08.616074 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:08.623381 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-014645ce-47aa-40a1-bd4d-cdd253463ec1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.381244 Aug 27 04:15:08.623942 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 939/1916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:08 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:08.735998 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-66007261-6ee2-4a89-92b9-3891de3af0d8 req-32b1f5c1-78c7-46c9-92fe-aa81358d84e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d7a9b0-ca7d-48e6-8997-91bb2a2de110", "tag": "e7d4291e-095e-41d5-8686-cf51d37f45e2"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:08.737971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:15:08.737971 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 04:15:08.747097 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-66007261-6ee2-4a89-92b9-3891de3af0d8 req-32b1f5c1-78c7-46c9-92fe-aa81358d84e9 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:08.747539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-66007261-6ee2-4a89-92b9-3891de3af0d8 req-32b1f5c1-78c7-46c9-92fe-aa81358d84e9 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:08.761881 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-66007261-6ee2-4a89-92b9-3891de3af0d8 req-32b1f5c1-78c7-46c9-92fe-aa81358d84e9 service nova] Creating event network-changed:e7d4291e-095e-41d5-8686-cf51d37f45e2 for instance c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 on hv-cinder-77398 Aug 27 04:15:08.770458 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-66007261-6ee2-4a89-92b9-3891de3af0d8 req-32b1f5c1-78c7-46c9-92fe-aa81358d84e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040299 Aug 27 04:15:08.771047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 978/1917] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:15:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:09.640332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:09.640981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:09.646807 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:09.647254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:09.648027 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:09.648466 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:09.788280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:09.795903 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c9456212-839d-431e-9156-cef204f34d4c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.159354 Aug 27 04:15:09.797244 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 940/1918] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:09 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:10.814491 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:10.815114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:10.821247 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:10.821644 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:10.822427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:10.822859 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:10.946141 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:10.954478 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-40152932-ccca-4d33-a67c-aa1b54908f18 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.144699 Aug 27 04:15:10.955047 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 979/1919] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:10 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:11.971785 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:11.972318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:11.978235 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:11.978685 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:11.979442 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:11.979874 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:12.104852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:12.112058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b97a34f9-39dc-4425-8c3f-8888e930676c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.144730 Aug 27 04:15:12.112789 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 941/1920] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:11 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:13.128534 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:13.129068 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:13.134907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:13.135351 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:13.136114 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:13.136544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:13.259794 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:13.267356 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f51f75e1-90ac-4aff-8510-ddb65a236fbd tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.142596 Aug 27 04:15:13.268193 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 980/1921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:13 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:14.283730 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:14.284310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:14.290238 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:14.290677 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:14.291430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:14.291851 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:14.414271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:14.422106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-63afe680-b260-4919-b0cb-a14e322e1ca3 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.141315 Aug 27 04:15:14.422663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 942/1922] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:14 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:14.696789 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-5354e570-96cd-483a-b214-4268f81d4d46 req-38c1567c-9c9f-4dc1-bc04-1e5276b684be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d7a9b0-ca7d-48e6-8997-91bb2a2de110", "name": "network-vif-plugged", "status": "completed", "tag": "e7d4291e-095e-41d5-8686-cf51d37f45e2"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:14.698365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:15:14.698365 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 04:15:14.705123 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-5354e570-96cd-483a-b214-4268f81d4d46 req-38c1567c-9c9f-4dc1-bc04-1e5276b684be service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:14.705558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-5354e570-96cd-483a-b214-4268f81d4d46 req-38c1567c-9c9f-4dc1-bc04-1e5276b684be service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:14.716588 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-5354e570-96cd-483a-b214-4268f81d4d46 req-38c1567c-9c9f-4dc1-bc04-1e5276b684be service nova] Creating event network-vif-plugged:e7d4291e-095e-41d5-8686-cf51d37f45e2 for instance c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 on hv-cinder-77398 Aug 27 04:15:14.722103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-5354e570-96cd-483a-b214-4268f81d4d46 req-38c1567c-9c9f-4dc1-bc04-1e5276b684be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028943 Aug 27 04:15:14.722681 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 981/1923] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:15:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:15.438635 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:15.439241 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:15.445112 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:15.445554 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:15.446341 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:15.446774 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:15.570899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:15.579567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d14c5c48-36fc-45a0-9232-db5442f9a50b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1318 microversion: 2.1 time: 0.145079 Aug 27 04:15:15.580151 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 943/1924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:15 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:16.597427 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:16.598162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:16.604186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:16.604629 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:16.605385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:16.605817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:16.729158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:16.736755 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3f18c3c9-2ea6-4845-8ab3-2393f9e2aa0a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1508 microversion: 2.1 time: 0.143938 Aug 27 04:15:16.737330 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 982/1925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:16 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:39.255588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eaff952-8341-4a4b-aad6-fa7ffe2baf5d", "device": "/dev/sdb"}} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:39.257211 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:39.263142 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:39.263577 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:39.264322 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:39.264745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:39.514737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5f18b887-03e3-497a-acfb-b03f23b32b67 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "POST /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262895 Aug 27 04:15:39.515331 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 944/1926] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 04:15:39 2021] POST /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:59.977418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:15:59.980777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:59.981306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:59.987188 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:59.987636 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:59.988404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:59.988830 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:00.011099 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lazy-loading 'flavor' on Instance uuid ea4b224d-cd73-4ff0-a7f4-b253ad968552 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:16:00.082722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b0e53b12-0952-4dc0-b5b7-0a2320df8b98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "POST /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552/action" status: 202 len: 0 microversion: 2.1 time: 0.106529 Aug 27 04:16:00.083306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 983/1927] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 04:15:59 2021] POST /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:16:00.092175 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:00.092971 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:00.100824 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:00.101374 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:00.102248 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:00.102734 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:00.229090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:00.236780 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fd345014-9f74-4a1a-ba8a-a8d63ae97646 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.149123 Aug 27 04:16:00.237338 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 945/1928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:00 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:01.264030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:01.264730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:01.272173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:01.272615 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:01.273388 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:01.273817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:01.278914 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] [c984b995-5f06-4f43-a21b-36b6860846aa] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 59812. Aug 27 04:16:01.397674 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:01.404910 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dac60197-fa64-4e67-a5d9-74ab5cfd3406 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.154666 Aug 27 04:16:01.405469 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 984/1929] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:01 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:02.423864 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:02.424478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:02.430760 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:02.431210 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:02.431977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:02.432411 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:02.556909 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:02.564745 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-717556e3-6228-4add-8e7a-b7a99fefa114 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.145026 Aug 27 04:16:02.565288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 946/1930] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:02 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:03.582109 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:03.582717 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:03.588557 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:03.589000 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:03.589885 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:03.590354 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:03.712864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:03.721169 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5d4bc0f4-bb91-4957-bcf8-ae85212a91e2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.143273 Aug 27 04:16:03.721735 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 985/1931] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:03 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:04.737893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:04.739134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:04.745141 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:04.745581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:04.746371 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:04.746804 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:04.869796 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:04.877535 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-9b167668-1085-4a43-ac58-21acf35056fc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.143285 Aug 27 04:16:04.878137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 947/1932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:04 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:05.894333 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:05.894864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:05.900737 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:05.901065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:05.901821 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:05.902267 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:06.032430 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:06.039604 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dbf6e9b3-e656-40c5-be94-5d6b714d9eb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.149171 Aug 27 04:16:06.040162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 986/1933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:05 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:07.056783 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:07.057531 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:07.065231 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:07.065692 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:07.066496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:07.066932 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:07.193538 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:07.201252 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-71134a2d-69f2-4a3d-9699-a8f828483016 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.148269 Aug 27 04:16:07.201883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 948/1934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:07 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:08.218030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:08.219383 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:08.225455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.225906 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.226706 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.227144 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.348577 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:08.356200 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-7904e98b-50bc-403c-8892-059bd3f10bc0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.141828 Aug 27 04:16:08.356763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 987/1935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:08 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:09.204833 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:09.205340 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:09.211161 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:09.211614 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:09.212378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:09.212816 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:09.298273 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.objects.instance [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lazy-loading 'services' on Instance uuid c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 {{(pid=109037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:16:09.361936 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b0df3125-c345-4a86-a541-ca8a749f52b1 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110/os-volume_attachments/5eaff952-8341-4a4b-aad6-fa7ffe2baf5d" status: 202 len: 0 microversion: 2.1 time: 0.161944 Aug 27 04:16:09.362563 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 949/1936] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 04:16:09 2021] DELETE /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110/os-volume_attachments/5eaff952-8341-4a4b-aad6-fa7ffe2baf5d => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:16:09.378372 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:09.379540 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:09.392837 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:09.393626 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:09.394321 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:09.394867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:09.524631 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:09.531891 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f1bc93c2-3056-42aa-b674-5b6287543ac1 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.157949 Aug 27 04:16:09.532448 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 988/1937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:09 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:09.799743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:16:09.799979 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:16:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:16:10.492552 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:10.493119 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:10.499192 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.500292 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.501064 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.501498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.526058 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:16:10.549172 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:10.550596 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:10.557289 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.557752 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.558548 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.558975 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.604771 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-50fdc7b4-ac5f-4b25-b181-5be231c391bf tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 204 len: 0 microversion: 2.1 time: 0.115856 Aug 27 04:16:10.605351 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 950/1938] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 04:16:10 2021] DELETE /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:10.615051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:10.615744 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:10.623150 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.623955 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.625412 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.625847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.712055 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:10.720154 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-848f9db5-981d-4fcb-9582-a1da8c1e1e45 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.175446 Aug 27 04:16:10.720813 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 989/1939] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:10 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:16:10.769321 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:10.776607 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-d2814f71-49cf-44d0-ad97-8e6d8890bdfa tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1514 microversion: 2.1 time: 0.165770 Aug 27 04:16:10.777168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 951/1940] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:10 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:11.737944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:11.738585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:11.744493 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.744935 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.745698 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.746164 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.794005 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:11.794656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:11.801417 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.801867 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.802680 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.803117 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.897508 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:11.904781 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-8ce26449-8b76-42da-9778-bee344f1a696 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.171541 Aug 27 04:16:11.905352 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 990/1941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:11 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:11.948289 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:11.956006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-503823a8-6591-4c18-9f4d-1512705bcd0b tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1514 microversion: 2.1 time: 0.165708 Aug 27 04:16:11.956567 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 952/1942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:11 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:16:12.923671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:12.924292 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:12.930392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.930862 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.931634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.932058 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.973060 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:12.973669 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:12.979433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.979871 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.980630 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.981051 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:13.183724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:13.191136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-eb0e6c47-2c60-4322-92d4-7838b2aba331 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.272220 Aug 27 04:16:13.191709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 991/1943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:12 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:13.241234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:13.248456 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5f0be3ea-5e15-4fce-9b94-0855bd4e4278 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 200 len: 1514 microversion: 2.1 time: 0.278986 Aug 27 04:16:13.249023 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 953/1944] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:12 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:16:13.581036 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-ad069d76-fded-40fe-ad8d-771347339748 req-f68b9a06-8dbd-495f-9bfa-30c2e233191b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d7a9b0-ca7d-48e6-8997-91bb2a2de110", "name": "network-vif-deleted", "tag": "e7d4291e-095e-41d5-8686-cf51d37f45e2"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:13.582895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:13.582895 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 04:16:13.590130 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ad069d76-fded-40fe-ad8d-771347339748 req-f68b9a06-8dbd-495f-9bfa-30c2e233191b service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:13.590566 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-ad069d76-fded-40fe-ad8d-771347339748 req-f68b9a06-8dbd-495f-9bfa-30c2e233191b service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:13.603496 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-ad069d76-fded-40fe-ad8d-771347339748 req-f68b9a06-8dbd-495f-9bfa-30c2e233191b service nova] Creating event network-vif-deleted:e7d4291e-095e-41d5-8686-cf51d37f45e2 for instance c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 on hv-cinder-77398 Aug 27 04:16:13.608723 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-ad069d76-fded-40fe-ad8d-771347339748 req-f68b9a06-8dbd-495f-9bfa-30c2e233191b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031394 Aug 27 04:16:13.609851 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 992/1945] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:14.208584 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:14.209200 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:14.215183 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.215622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.216386 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.216815 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.267517 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:14.268131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: c1d7a9b0-ca7d-48e6-8997-91bb2a2de110] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:14.274199 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.274630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.275488 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.275924 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.290311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.wsgi [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] HTTP exception thrown: Instance c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 could not be found. Aug 27 04:16:14.290854 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Returning 404 to user: Instance c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 could not be found. {{(pid=109036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:16:14.291692 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4cdf7444-eed6-480e-8f15-59e148a8fecb tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110" status: 404 len: 111 microversion: 2.1 time: 0.029432 Aug 27 04:16:14.292238 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 993/1946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:14 2021] GET /compute/v2.1/servers/c1d7a9b0-ca7d-48e6-8997-91bb2a2de110 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:16:14.347516 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:14.355120 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-49e5f98a-3537-41d6-8563-cca540ee4ba9 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.150265 Aug 27 04:16:14.355686 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 954/1947] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:14 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:15.374392 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:15.375008 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:15.381404 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:15.382042 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:15.382807 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:15.383231 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:15.504802 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:15.512072 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-d2cdba90-d90e-4ef4-9efd-b818ba8a4951 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.141429 Aug 27 04:16:15.512657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 994/1948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:15 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:16.528271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:16.528883 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:16.535188 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:16.535633 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:16.536392 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:16.536822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:16.656557 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:16.664299 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a9c213c9-08d3-4cd1-9d0b-a1974a94fc12 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.139655 Aug 27 04:16:16.664863 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 955/1949] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:16 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:17.681919 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:17.682465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:17.688796 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:17.689385 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:17.690225 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:17.690657 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:17.814607 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:17.821903 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-a60197c9-baa6-4f16-87bd-9135700e3788 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.143727 Aug 27 04:16:17.822510 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 995/1950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:17 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:18.839418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:18.839964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:18.846458 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.846907 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:18.847673 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.848102 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:18.968015 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:18.976214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6bcba6e4-827d-4e18-b882-3e9d559b937a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.140897 Aug 27 04:16:18.976786 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 956/1951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:18 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:19.993643 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:19.994280 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:20.000089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:20.000559 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:20.001648 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:20.001840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:20.211616 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:20.218882 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-0b294677-659c-4dc6-bb38-0c865f003d98 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.228933 Aug 27 04:16:20.220098 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 996/1952] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:19 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:21.236668 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:21.237287 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:21.243214 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:21.243663 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:21.244459 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:21.244893 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:21.370831 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:21.378983 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-ee2cbe54-a1ee-45a7-b0cb-b963cd6e6cb0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.146179 Aug 27 04:16:21.379548 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 957/1953] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:21 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:22.396018 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:22.396539 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:22.402413 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:22.402857 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:22.403618 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:22.404046 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:22.525311 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:22.532658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-e48264f9-41c3-4fc7-a92e-751a95c4dd40 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.140445 Aug 27 04:16:22.533221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 997/1954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:22 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:23.550350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:23.551011 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:23.556899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:23.557347 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:23.558148 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:23.558588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:23.686922 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:23.694288 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-60c1040f-9928-4481-b211-6f381052e7bf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.148562 Aug 27 04:16:23.694852 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 958/1955] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:23 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:24.711409 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:24.712017 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:24.717879 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:24.718341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:24.719300 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:24.719798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:24.841853 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:24.849341 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3cb7b797-881e-490b-954b-e005a6218d93 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.141575 Aug 27 04:16:24.849920 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 998/1956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:24 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:25.866180 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:25.866743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:25.872737 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:25.873191 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:25.873964 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:25.874427 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:25.996174 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:26.004117 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-267219b2-0e1b-4f38-9274-18bd867cd56d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.141733 Aug 27 04:16:26.004681 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 959/1957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:25 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:26.947255 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-aa4eda59-f636-4bd1-ab88-fd72c19c5e98 req-933473b9-b0dd-4f7c-85ea-22d312d31a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "name": "network-vif-unplugged", "status": "completed", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:26.948763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:26.948763 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 04:16:26.956374 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-aa4eda59-f636-4bd1-ab88-fd72c19c5e98 req-933473b9-b0dd-4f7c-85ea-22d312d31a36 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:26.956817 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-aa4eda59-f636-4bd1-ab88-fd72c19c5e98 req-933473b9-b0dd-4f7c-85ea-22d312d31a36 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:26.968101 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-aa4eda59-f636-4bd1-ab88-fd72c19c5e98 req-933473b9-b0dd-4f7c-85ea-22d312d31a36 service nova] Creating event network-vif-unplugged:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:16:26.973744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-aa4eda59-f636-4bd1-ab88-fd72c19c5e98 req-933473b9-b0dd-4f7c-85ea-22d312d31a36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030107 Aug 27 04:16:26.974567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 999/1958] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:27.026707 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:27.027452 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:27.033753 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:27.034230 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:27.034993 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:27.035449 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:27.135384 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1189294739", "imageRef": "c9af87a2-b5a3-4aff-ba32-20a1ffa3657f", "flavorRef": "452", "networks": [{"uuid": "80353014-5249-42ff-8f3c-8f5139aa2059"}]}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:27.160654 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:27.167890 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-430f8b57-47bd-4a45-a6a2-3cbc98ba0834 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.147609 Aug 27 04:16:27.168461 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 960/1959] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:27 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:27.205977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.network.neutron [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] validate_networks() for [('80353014-5249-42ff-8f3c-8f5139aa2059', None, None, None, None, None)] {{(pid=109036) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:16:27.577867 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Flavor limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:16:27.578363 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Image limits 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:16:27.578832 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Flavor pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:16:27.579240 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Image pref 0:0:0 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:16:27.579654 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.virt.hardware [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:16:27.588435 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:27.588875 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:27.589666 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:27.590158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:27.606845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Getting quotas for project af2f83a6efc64cc4adef358d27182277. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:16:27.611320 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.quota [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Getting quotas for user 45fc7c98bb9245c5b4947cc72343db7d and project af2f83a6efc64cc4adef358d27182277. Resources: {'cores', 'ram', 'instances'} {{(pid=109036) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:16:27.622434 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Going to run 1 instances... {{(pid=109036) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:16:27.624805 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9af87a2-b5a3-4aff-ba32-20a1ffa3657f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:16:27.670554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4256b22c-853a-465e-b32e-6021a305f438 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539208 Aug 27 04:16:27.671645 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1000/1960] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Aug 27 04:16:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:16:27.681186 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-700a68c4-6950-4fc5-88ea-4376154c0e00 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:27.681924 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-700a68c4-6950-4fc5-88ea-4376154c0e00 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:27.744306 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-700a68c4-6950-4fc5-88ea-4376154c0e00 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:27.751817 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-700a68c4-6950-4fc5-88ea-4376154c0e00 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1219 microversion: 2.1 time: 0.074215 Aug 27 04:16:27.752779 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 961/1961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:27 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:28.185273 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:28.185883 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:28.192866 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.193244 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.194030 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.194459 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.321977 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:28.329516 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-737d8e1b-af6a-4809-a3a7-6241138cc1c0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1509 microversion: 2.1 time: 0.147882 Aug 27 04:16:28.330177 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1001/1962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:28 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:28.345310 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:28.345877 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:28.351656 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.352092 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.352855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.353285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.430418 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-283e45c1-0493-4e9b-b805-82923c27ac3e tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "POST /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552/action" status: 202 len: 0 microversion: 2.1 time: 0.088589 Aug 27 04:16:28.431213 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 962/1963] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:28 2021] POST /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:16:28.442728 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:28.443368 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:28.450222 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.450663 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.451422 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.452057 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.581033 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:28.589544 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-f61d42f5-156b-44a0-bd9b-92ca60aaea2a tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1517 microversion: 2.1 time: 0.151815 Aug 27 04:16:28.590481 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1002/1964] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:28 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:28.768763 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:28.769419 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:28.778247 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.778888 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.779841 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.780455 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.857433 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:28.865773 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c7752f23-7ca8-4b7e-a8d4-60504af4922a tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1277 microversion: 2.1 time: 0.101946 Aug 27 04:16:28.866496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 963/1965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:28 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:29.607480 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:29.608221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:29.615669 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.616197 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.617060 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.617658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.816169 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:29.823375 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5fb0e03f-fe6a-40cc-af02-254802b9a297 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1519 microversion: 2.1 time: 0.219733 Aug 27 04:16:29.823939 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1003/1966] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:29 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:29.887369 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:29.891185 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:29.897588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.898329 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.899106 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.899537 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.363285 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:30.374397 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c3c304fa-ec88-47c1-8ba3-b7e57083d732 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1319 microversion: 2.1 time: 0.493511 Aug 27 04:16:30.382054 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 964/1967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:29 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:30.445630 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-76ac5170-7605-489d-b1b6-de159d5af99d req-96e1e695-eb86-497f-88e2-04af2d27d213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3251f0-ed06-4a10-8c45-19ac6fe271a6", "tag": "de7fc502-05fc-413e-9e57-1e2409e7cc31"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:30.447242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:30.447242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 04:16:30.459620 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-76ac5170-7605-489d-b1b6-de159d5af99d req-96e1e695-eb86-497f-88e2-04af2d27d213 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.460934 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-76ac5170-7605-489d-b1b6-de159d5af99d req-96e1e695-eb86-497f-88e2-04af2d27d213 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.474565 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-76ac5170-7605-489d-b1b6-de159d5af99d req-96e1e695-eb86-497f-88e2-04af2d27d213 service nova] Creating event network-changed:de7fc502-05fc-413e-9e57-1e2409e7cc31 for instance 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 on hv-cinder-77398 Aug 27 04:16:30.481678 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-76ac5170-7605-489d-b1b6-de159d5af99d req-96e1e695-eb86-497f-88e2-04af2d27d213 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039703 Aug 27 04:16:30.482316 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1004/1968] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:30.840703 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:30.841317 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:30.847572 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.848030 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.848966 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.849406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.992254 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:30.999743 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-63167682-feb5-48ea-99f3-d50d316ac004 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.162933 Aug 27 04:16:31.000599 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 965/1969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:30 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:31.394187 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:31.394889 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:31.401960 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:31.402462 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:31.403206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:31.403658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:31.529820 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:31.537848 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-3102a111-6dc7-49fc-b6ed-51ed09fbe564 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1319 microversion: 2.1 time: 0.148615 Aug 27 04:16:31.538655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1005/1970] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:31 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:32.017722 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:32.018364 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:32.024234 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:32.024679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.025447 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:32.025910 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.148416 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:32.155604 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-53810d25-ba02-4fef-b93e-aa27518cdf31 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.142371 Aug 27 04:16:32.156325 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 966/1971] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:32 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:32.554300 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:32.554909 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:32.560907 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:32.561377 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.562228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:32.562902 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.687181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:32.694824 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-4de841bb-bd7a-40cd-8bbc-0533f52d32e9 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1319 microversion: 2.1 time: 0.144146 Aug 27 04:16:32.695393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1006/1972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:32 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:33.172970 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:33.173527 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:33.179463 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.179912 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.180679 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.181113 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.300770 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:33.308147 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-17a5d89c-78ce-43c2-84fa-f636be3988cf tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.139236 Aug 27 04:16:33.308696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 967/1973] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:33 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:33.711838 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:33.712451 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:33.718335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.719321 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.720093 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.720530 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.845551 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:33.853415 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-74550f17-d59f-4105-b771-0656b77fb285 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1319 microversion: 2.1 time: 0.145225 Aug 27 04:16:33.854393 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1007/1974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:33 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:34.324819 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:34.325432 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:34.332271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:34.332727 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:34.333495 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:34.333929 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:34.458082 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:34.465440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-0c980408-0337-456c-b0cf-1518c62c98dc tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.144362 Aug 27 04:16:34.466006 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 968/1975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:34 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:34.871926 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:34.872570 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:34.879016 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:34.879465 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:34.880234 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:34.880667 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.006284 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:35.013722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-55b70978-777d-4aa8-8043-2818f758695f tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1319 microversion: 2.1 time: 0.146753 Aug 27 04:16:35.014335 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1008/1976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:34 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:35.069885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-6513873f-f213-4545-9b3e-10699086cfee req-a9c8d9cb-3017-4809-89ab-d6a316432418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3251f0-ed06-4a10-8c45-19ac6fe271a6", "name": "network-vif-plugged", "status": "completed", "tag": "de7fc502-05fc-413e-9e57-1e2409e7cc31"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:35.071496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:35.071496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:16:35.078846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-6513873f-f213-4545-9b3e-10699086cfee req-a9c8d9cb-3017-4809-89ab-d6a316432418 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:35.079326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-6513873f-f213-4545-9b3e-10699086cfee req-a9c8d9cb-3017-4809-89ab-d6a316432418 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.090758 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-6513873f-f213-4545-9b3e-10699086cfee req-a9c8d9cb-3017-4809-89ab-d6a316432418 service nova] Creating event network-vif-plugged:de7fc502-05fc-413e-9e57-1e2409e7cc31 for instance 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 on hv-cinder-77398 Aug 27 04:16:35.095726 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-6513873f-f213-4545-9b3e-10699086cfee req-a9c8d9cb-3017-4809-89ab-d6a316432418 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029424 Aug 27 04:16:35.096318 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 969/1977] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:35.482966 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:35.483573 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:35.490285 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:35.490722 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.491730 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:35.491944 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.614741 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:35.621933 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ff4fc02d-e6ec-4b9f-8090-876278ca6673 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.142683 Aug 27 04:16:35.622525 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1009/1978] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:35 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:36.032126 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:36.032855 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:36.040358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:36.040806 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:36.041580 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:36.042040 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:36.167640 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:36.176068 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-b038cf4a-0d64-4aa2-b99d-dc7f487b8e99 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1319 microversion: 2.1 time: 0.148388 Aug 27 04:16:36.176631 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 970/1979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:36 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:36.639038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:36.639655 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:36.646254 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:36.646705 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:36.647476 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:36.647913 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:36.772590 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:36.780076 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-ebddafa8-be96-4b16-befb-ec0ebbcc5e7b tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.144690 Aug 27 04:16:36.780650 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1010/1980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:36 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:37.193280 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:37.193816 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:37.199696 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.200134 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.200899 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.201332 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.320632 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:37.327822 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-c093c197-435b-4e12-8060-185e68cc2642 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1508 microversion: 2.1 time: 0.138357 Aug 27 04:16:37.328377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 971/1981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:37 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1508 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:37.343707 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98bb1440-4c2d-476d-a7f0-9ac5952eac5e", "device": "/dev/sdb"}} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:37.345765 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:37.351603 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.352052 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.352822 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.353260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.595482 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-097bdcd7-c532-4761-969d-6a0c8b16c775 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "POST /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255451 Aug 27 04:16:37.596089 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1011/1982] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Aug 27 04:16:37 2021] POST /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:37.799436 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:37.800168 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:37.805889 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.806378 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.807137 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.807568 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.932634 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:37.940256 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-10729f12-6cc5-4221-9507-d2365a0ea479 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.145564 Aug 27 04:16:37.940823 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 972/1983] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:37 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:38.958370 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:38.959185 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:38.965492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:38.965928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:38.966744 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:38.967173 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:39.091065 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:39.099186 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-72aa73b9-bf77-4bfc-a270-8b25352af9af tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.146161 Aug 27 04:16:39.099833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1012/1984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:38 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:40.116335 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:40.116950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:40.122947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:40.123393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:40.124153 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:40.124585 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:40.244314 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:40.252146 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-7dd7c0a3-5d59-4bac-ae82-4fd540d3af8d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.139493 Aug 27 04:16:40.252708 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 973/1985] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:40 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:41.078761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [req-c4cbc11a-98da-4412-a209-5e68d3d170ed req-a4e739e5-f5eb-4c99-8b4d-d832f779c5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "name": "network-vif-plugged", "status": "completed", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:41.080331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:41.080331 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: warnings.warn(msg) Aug 27 04:16:41.087773 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c4cbc11a-98da-4412-a209-5e68d3d170ed req-a4e739e5-f5eb-4c99-8b4d-d832f779c5e8 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:41.088260 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [req-c4cbc11a-98da-4412-a209-5e68d3d170ed req-a4e739e5-f5eb-4c99-8b4d-d832f779c5e8 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:41.100281 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.compute.server_external_events [req-c4cbc11a-98da-4412-a209-5e68d3d170ed req-a4e739e5-f5eb-4c99-8b4d-d832f779c5e8 service nova] Creating event network-vif-plugged:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:16:41.105161 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [req-c4cbc11a-98da-4412-a209-5e68d3d170ed req-a4e739e5-f5eb-4c99-8b4d-d832f779c5e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Aug 27 04:16:41.105940 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1013/1986] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:41.269300 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:41.269905 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:41.277393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:41.277393 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:41.278326 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:41.283171 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:41.407496 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:41.417099 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-61f30fdb-6321-465c-83cc-2746a64a64a2 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.151865 Aug 27 04:16:41.417678 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 974/1987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:41 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:42.435492 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:42.436221 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:42.442928 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:42.443379 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:42.444136 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:42.444567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:42.567182 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:42.574593 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-b112823e-e774-4a2f-870c-38d29bc976c6 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1575 microversion: 2.1 time: 0.143119 Aug 27 04:16:42.575162 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1014/1988] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:42 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:43.591424 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:43.592033 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:43.598647 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:43.599090 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:43.599846 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:43.600271 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:43.720684 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:43.727896 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-481c5eb9-32f4-4d20-8a80-5ce89139bcd0 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1562 microversion: 2.1 time: 0.140167 Aug 27 04:16:43.728453 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 975/1989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:43 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:59.900306 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:59.900833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:59.907252 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:59.907694 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:59.908457 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:59.908888 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:59.992297 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lazy-loading 'services' on Instance uuid 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:17:00.063086 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-59008951-37b6-4888-8340-62b3d0248add tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6/os-volume_attachments/98bb1440-4c2d-476d-a7f0-9ac5952eac5e" status: 202 len: 0 microversion: 2.1 time: 0.165647 Aug 27 04:17:00.063671 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1015/1990] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Aug 27 04:16:59 2021] DELETE /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6/os-volume_attachments/98bb1440-4c2d-476d-a7f0-9ac5952eac5e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:17:01.181838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:01.182350 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:01.188830 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:01.189739 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:01.190544 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:01.190977 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:01.216582 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Going to try to terminate instance {{(pid=109037) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:17:01.299803 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-6cf2f8d1-22b6-49a2-a75b-c7b4dd04df95 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 204 len: 0 microversion: 2.1 time: 0.121449 Aug 27 04:17:01.300793 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 976/1991] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 04:17:01 2021] DELETE /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:01.309511 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:01.310411 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:01.316882 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:01.317327 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:01.318116 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:01.318550 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:01.445634 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:01.453283 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-eac78d90-48da-4afa-b880-64923d76b41c tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1514 microversion: 2.1 time: 0.147367 Aug 27 04:17:01.453845 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1016/1992] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:01 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:02.471255 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:02.471947 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:02.477759 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:02.478225 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:02.478981 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:02.479429 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:02.600885 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:02.608279 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-fa5fb0dd-3466-4e61-9f06-c36a9f0d2c33 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1514 microversion: 2.1 time: 0.141613 Aug 27 04:17:02.609413 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 977/1993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:02 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:03.626386 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:03.627008 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:03.632909 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:03.633357 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:03.634420 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:03.634856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:03.758870 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:03.766397 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-433ad755-6dcb-4f1c-921e-efbb10aa6b39 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1514 microversion: 2.1 time: 0.144626 Aug 27 04:17:03.766963 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1017/1994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:03 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:04.403562 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-f1e18ca6-c7ab-4dee-bab9-af1ab7e00ea6 req-cb166eb2-f569-4b3b-b4f9-c9a460934461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3251f0-ed06-4a10-8c45-19ac6fe271a6", "name": "network-vif-deleted", "tag": "de7fc502-05fc-413e-9e57-1e2409e7cc31"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:04.405430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:17:04.405430 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:17:04.413950 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-f1e18ca6-c7ab-4dee-bab9-af1ab7e00ea6 req-cb166eb2-f569-4b3b-b4f9-c9a460934461 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:04.414484 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-f1e18ca6-c7ab-4dee-bab9-af1ab7e00ea6 req-cb166eb2-f569-4b3b-b4f9-c9a460934461 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:04.426643 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-f1e18ca6-c7ab-4dee-bab9-af1ab7e00ea6 req-cb166eb2-f569-4b3b-b4f9-c9a460934461 service nova] Creating event network-vif-deleted:de7fc502-05fc-413e-9e57-1e2409e7cc31 for instance 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 on hv-cinder-77398 Aug 27 04:17:04.431838 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-f1e18ca6-c7ab-4dee-bab9-af1ab7e00ea6 req-cb166eb2-f569-4b3b-b4f9-c9a460934461 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031890 Aug 27 04:17:04.432485 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 978/1995] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:17:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:17:04.782967 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:04.783567 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:04.789460 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:04.789893 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:04.790675 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:04.791103 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:04.820819 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:04.821195 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:04.821624 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lazy-loading 'fault' on Instance uuid 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:17:04.866455 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fc7c98bb9245c5b4947cc72343db7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f83a6efc64cc4adef358d27182277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:04.873719 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-1b89b063-0233-4a1f-9029-d3590d5138a2 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 200 len: 1309 microversion: 2.1 time: 0.094573 Aug 27 04:17:04.874945 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1018/1996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:04 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:05.892193 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:05.892886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] [instance: 0c3251f0-ed06-4a10-8c45-19ac6fe271a6] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:05.898941 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:05.899377 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:05.900155 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:05.900581 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:05.913289 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] HTTP exception thrown: Instance 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 could not be found. Aug 27 04:17:05.913862 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] Returning 404 to user: Instance 0c3251f0-ed06-4a10-8c45-19ac6fe271a6 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:17:05.914698 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-5bb486b9-ff9d-4055-9a53-fa04c1aca4c5 tempest-VolumesSnapshotTestJSON-1614597064 tempest-VolumesSnapshotTestJSON-1614597064-project] 10.222.0.48 "GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6" status: 404 len: 111 microversion: 2.1 time: 0.026835 Aug 27 04:17:05.915209 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 979/1997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:05 2021] GET /compute/v2.1/servers/0c3251f0-ed06-4a10-8c45-19ac6fe271a6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:17:52.491666 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:17:52.492440 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:17:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:18:08.447585 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:18:08.448265 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:18:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:18:36.002004 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:18:36.002833 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:36.003342 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:18:36.010724 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:36.011366 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:36.012612 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:36.013242 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:36.040028 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Going to try to terminate instance {{(pid=109036) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:18:36.120376 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-5f3c0a99-db71-4532-b7fe-0822b47caf80 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 204 len: 0 microversion: 2.1 time: 0.122411 Aug 27 04:18:36.121359 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1019/1998] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Aug 27 04:18:35 2021] DELETE /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:36.130787 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:36.131142 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:18:36.137418 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:36.137864 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:36.138711 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:36.139139 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:36.151478 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-efe22eb4-b85f-44a0-af9a-9ee2cd9f7262 req-c28e0739-df4c-49b1-8a41-a1daa9f34996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:36.153131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:18:36.153131 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:18:36.160267 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-efe22eb4-b85f-44a0-af9a-9ee2cd9f7262 req-c28e0739-df4c-49b1-8a41-a1daa9f34996 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:36.160710 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-efe22eb4-b85f-44a0-af9a-9ee2cd9f7262 req-c28e0739-df4c-49b1-8a41-a1daa9f34996 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:36.173182 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-efe22eb4-b85f-44a0-af9a-9ee2cd9f7262 req-c28e0739-df4c-49b1-8a41-a1daa9f34996 service nova] Creating event network-changed:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:18:36.178608 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-efe22eb4-b85f-44a0-af9a-9ee2cd9f7262 req-c28e0739-df4c-49b1-8a41-a1daa9f34996 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178277 Aug 27 04:18:36.179320 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 980/1999] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:18:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:36.339904 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:36.347658 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-2df2ea56-56c3-494f-86b5-2f421200a728 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1568 microversion: 2.1 time: 0.221792 Aug 27 04:18:36.348228 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1020/2000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:18:36 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:37.375882 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:37.376498 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:18:37.384404 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:37.385184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:37.385963 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:37.386422 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:37.389886 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] [cce7addd-0e0e-4e84-8574-97176383522c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60354. Aug 27 04:18:37.564362 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.policy [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109037) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:37.572272 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-266c6bf4-da71-4f6c-923f-adeb8df166ca tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1449 microversion: 2.1 time: 0.210573 Aug 27 04:18:37.572958 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 981/2001] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:18:37 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1449 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:38.589958 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:38.590702 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:18:38.596506 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:38.596949 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:38.597709 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:38.598165 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:38.719840 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:38.727131 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-42c9997d-6c9a-4a68-9e51-ac4f2276aa05 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1449 microversion: 2.1 time: 0.140816 Aug 27 04:18:38.727761 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1021/2002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:18:38 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:38.955898 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [req-97701e25-cabc-48ac-8477-220f9dd7f1b4 req-f3e070fc-71d2-4c6f-b027-4ca6930e7da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b224d-cd73-4ff0-a7f4-b253ad968552", "name": "network-vif-deleted", "tag": "b0e073ba-4228-44fe-bdc0-e5cec33baf12"}]} {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:38.957406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:18:38.957406 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: warnings.warn(msg) Aug 27 04:18:38.964650 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-97701e25-cabc-48ac-8477-220f9dd7f1b4 req-f3e070fc-71d2-4c6f-b027-4ca6930e7da1 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:38.965070 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [req-97701e25-cabc-48ac-8477-220f9dd7f1b4 req-f3e070fc-71d2-4c6f-b027-4ca6930e7da1 service nova] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:38.977997 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.compute.server_external_events [req-97701e25-cabc-48ac-8477-220f9dd7f1b4 req-f3e070fc-71d2-4c6f-b027-4ca6930e7da1 service nova] Creating event network-vif-deleted:b0e073ba-4228-44fe-bdc0-e5cec33baf12 for instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 on hv-cinder-77398 Aug 27 04:18:38.982847 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [req-97701e25-cabc-48ac-8477-220f9dd7f1b4 req-f3e070fc-71d2-4c6f-b027-4ca6930e7da1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090671 Aug 27 04:18:38.983416 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 982/2003] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Aug 27 04:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:39.744010 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:39.744733 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.compute.api [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109036) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:18:39.751263 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:39.751811 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:39.752753 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:39.753206 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:39.790856 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:39.791181 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG oslo_concurrency.lockutils [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:39.791777 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.objects.instance [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lazy-loading 'fault' on Instance uuid ea4b224d-cd73-4ff0-a7f4-b253ad968552 {{(pid=109036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:18:39.832003 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.policy [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7f659c1c3b4f148436e57eefd8b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814e05e5f20b4f4588cdb9be1602d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109036) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:39.840400 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-dbed6b26-b02a-4355-819f-f5b2a5a9ec10 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 200 len: 1222 microversion: 2.1 time: 0.100207 Aug 27 04:18:39.841288 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1022/2004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:18:39 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:40.857358 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '>' {{(pid=109037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:40.857965 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.compute.api [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] [instance: ea4b224d-cd73-4ff0-a7f4-b253ad968552] Fetching instance by UUID {{(pid=109037) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:18:40.864749 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:40.865208 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:40.865954 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:18:40.866415 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG oslo_concurrency.lockutils [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Lock "744d09d0-5228-4066-927d-4e439a7622b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:18:40.879184 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.wsgi [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] HTTP exception thrown: Instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 could not be found. Aug 27 04:18:40.879765 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: DEBUG nova.api.openstack.wsgi [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Returning 404 to user: Instance ea4b224d-cd73-4ff0-a7f4-b253ad968552 could not be found. {{(pid=109037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:18:40.880588 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO nova.api.openstack.requestlog [None req-a329e650-02a2-44e1-8c96-04b39d880b0d tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552" status: 404 len: 111 microversion: 2.1 time: 0.027358 Aug 27 04:18:40.881135 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: [pid: 109037|app: 0|req: 983/2005] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Aug 27 04:18:40 2021] GET /compute/v2.1/servers/ea4b224d-cd73-4ff0-a7f4-b253ad968552 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:18:41.042793 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: DEBUG nova.api.openstack.wsgi [None req-90db0acd-0f1e-432b-abf2-343a67cfd381 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] Calling method '.version_select at 0x7fb1311048b0>' {{(pid=109036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:41.066798 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO nova.api.openstack.requestlog [None req-90db0acd-0f1e-432b-abf2-343a67cfd381 tempest-TestShelveInstance-542440379 tempest-TestShelveInstance-542440379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-131174055" status: 202 len: 0 microversion: 2.1 time: 0.028743 Aug 27 04:18:41.067614 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: [pid: 109036|app: 0|req: 1023/2006] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Aug 27 04:18:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-131174055 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:19:27.027038 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:19:27.027886 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:19:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:19:29.817622 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:19:29.818328 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:19:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:21:12.508736 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:21:12.509464 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:21:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:21:28.463982 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:21:28.464558 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:21:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:21:33.754913 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:21:33.755543 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:21:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:21:36.384554 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:21:36.385158 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:21:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:22:47.044586 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:22:47.045227 dv-cinder-773985-14-iscsi devstack@n-api.service[109036]: Fri Aug 27 04:22:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:22:49.835023 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:22:49.835541 dv-cinder-773985-14-iscsi devstack@n-api.service[109037]: Fri Aug 27 04:22:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!